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EXECUTIVE SUMMARY 



Introduction ^ ^ ; . ■ ' 

This report describes the evaluation conducted ^during the ISTS-'Ve school 
year by the evaluation unit of the Experience-Based Career Edupatiorr (EBCE) 
progranr-at Northwest Regional Educational Laboratory * (NWRELr/. EBCE is a 
comprehensive, individualized career education program that integrat;es a 
high school- student's learning of Basic Skills, Life Skills. and Career 
Development through work and learning experiences in the community. This x 
repor.t focUses on findings from the evaluation of the EBCE demonstration 
project in Tig^a, Oregon, called Commur^ty Experiences for Careef 
Education — (CE)2f the five NWREL EBCE pilot ^ites and separate EBCE 
materials. <i • 

■" r, . /' • ■;' 

Audiences " * ^ ' \ . \ 

Audiences for whdm this report is intended include the National Itistitute^ ' 
of E<3ucation, sponsor of EBCE research and development; educators in . 
districts that have recently adopted EBCE; personnel associated with (CE)2 
and the pilot sites from whom data were collected^ educational researchers ^ 
and persons interested in career education and alternative educational " 
programs. , ^ » , , ^ . 



'Demonstration Site Findings * ^ . * 

The 1975-76r schoj31. year marked the fourth year of operation for ICE) , 
which 'is operated in Tigard, * Oregon, by a nonprofit-^ community corporation 
as*yWREL's demonstration site. (^)2 approximately 60 high 

school juniors^ and seniors from Tigeurd High School a^id hOT a professional 
, staff of 7 members. Over 120 employers and communiixy people co^perated-^^ 
with'(CE)2 in providing leaCrning ^exper'iences. for students in the coOTsunity, 



yhe (CE)^ data contained in this report Renter around'the 1975-76 school 
year f^din^s for first-ye4^ and second-year students in the proga^am and on 
the^ second-year effects* on students participating in EBCE." An indepth 
evaluation of the '(CE)^ deitionstratibn project occurred in the 1974-75 
school year* ' ^However, one evaluation question that was considered important 
by the National Institute of Education and other audiences dealt with the 
cumixlative effects that EBCE might have" on' students who participated in the 
program for ^two complete years. The 1975-76 evaluation of (CE) undertook 
to ciddress that question, ^ . 

; •> . . , • ■ - 

Fourteen ^(CE) • two-year students entered the program in September 1974 arid' 
completed' pretests at\that time, ^ first-year jposttests in May, 1975 and 
second-year posttest^s^ji'n May 1976. The reading comprehension,. arithmelMrC 
concepts and arithmetic applications subtests of th^ Comfig.ehensive Tefet 



of Basic Skills were used to ♦festimat^ growth in their » basic skills. .a?hese j 
students demonstrated;. two year^'s growth ^in reading compr^ensibp during^ 
"the firs1:*year of progjram'Varticipation and an^ additional year of growt^ 
during the second ye^r. Very'lfttie growth' wasv^^etected on either of^fche 
arithmetic subtests. ' * ■* . * 



Growth on some 'ofv the Life Skills goals 'was assessed indirectly throug] 
use ofvthe Psychosocial Maturity Scale .developed by 'Ellen Greenberge'r 
cind as'sociates at the Center for Soqial Organization of Schools at JohfJs 
, Hopkins University. No significant gain^ for- two-year -students' were 
registered on^this ^ins-^ument nor'on' €iie Self Directed Search which 
assessed the care^l: preferences oj^stud^nts. • * • , • 

An evaJtuatic^ of first-year and second-yeaa: 'jEJarticipants in XQ£) ^ durind 
the 1975-76 school year \&fas /Conducted usihg data for 17 first-year students 
.and 14 second-yeap students. ' The major findings -can 't)e summarized in^i:€ 
statements: 



In Basic Skills, §tudents showed an average of one month'*"s*' 
growth in reading comprehension for each month of program 
participation even though their pretest scores .were at ^high 
\ level. Students also demonstrated marginal ^w:owth on / 
.arithmetic subtests, * * , . *T 



2. 



3. 



4. 



Bothj. first-year and second-year (CE)^ student groups ;demonstrat|| id 
significant' g2;owth on attitude scales^ measuring "openness to 
change'' and "tolerance," but the second-year^ student change.* 
was negative,' E6§xilting in a sij^i^f icant difference between 
the two groups, 'in addition, second-year -students exhibited 
positive .growth on 'Vork and "roles" and /letgative growth on 
"social commitment." , ' ? \ , 

First-year students demoirfetVated a positive significant- increase 
in educ^^tion^l aspirations with a s-light decrease in occupational 
aspirations. Data were not available for -second-year students/ 

By 'the ei^d^of the school year all students had>'^ome idea of 
what they^ would be doing one ^year after high ^school, while 
'ovpr one-quarter -did not know at the' beginning of the year, 
Over 90 percent plan to continue their education "beyp^nd high 
school.' Less than 7 percent of the student^ 'wer^dnt^estedj 
in unskill^pd' occupations^ ' 



'5. 



'Almost alliof th6 students reported working or observiftg^^at f 
one or both 'Occupations of prirtiary interest*-' Every, studen^if 
retforted kriOwledge "of how to enter these caj;eers of iriterest. 

Students r,dlted (CE)^ highest in helping them unfderstand moire 
about themselves, fiC one's interests -^nd ai^iXities/with / 
potential careers: and accept adult responsibilitt^. All, 
students', eiic^pt four who were unsure, -said that if .they _1 ^ 



* ' had it Ho do bver-, again they^'would decide -to participate 

♦ ' iQ EBCE* ' ' * * . ' * * ' 

7. Greatest program 'Strengths noted by students were overaj,! 
quality of the pj^Sgram, opportunity"' to- learn, about , 
< occupatiions and motivation to learn,. Although almoin a; 

third-:Df^ the students indicated no jJrogram weaknes,ges ,^ six 
* mentioned a lack of adequate basic ^ill^ development and 

' five mentioned a perceived need for improved staff . ^ , 
communications. ^ ' * * * '< - 

' 8. Staff, membeps perceived that greatest student* growth ^ " ^ ' ^ 
/occurred in the areas pf self-esteem, individual responsibility, 
i#Learning how to-learn, ability to communicate witk adult^ 
"incltroing parents, ^oral and* written communications, basic 
' skills ,\ willingife^s to try new things and coping skills* 
Moderate growtji. As viewed by the staff, occurred* in - 
awareness-~©fnonpraditional careers/ knowledge about the ' 
job>market and 'career 4ecision-making skills* 

^9. - In comparison to the previous year i^he tStaff sa\sj the program 
becomi^ig more stable, having a ^eater -proportion of self- 
directed students, implementing the student accountability' 
system more effectively and coordinating the student tutpring , 
^system better. Problem areas noted by the staff include^d 
less feeling of a student commu'nity than ftie 'p^ior yeax ' 
. .^nd less than desired progress in integrating basic skills ^ 
at employer sites* • * 

. ^ ' • ' > ' ' ; . v'-w 

10* Each staff .member^ indicated a willingness to J)aj:*^icipate in 
SBCE training' and demonstration activities in the coming, . 
. , ^ year &nd indicated areas in which they felt they could help 
most effectively. . * * ♦ • " ' 

* ' / • . 

Pilot* Site Findings/j . • ' * / 

Puring the 1975-76 scihool year there were five' district^ tfic^t agreed to 
use the NWREL version -of EBCE* .;P|iese districts agree^l to u?e EBCE as 
a full program and to' pooperate with NWREL in coll'pcting evaluation .data* 
In return the -districts recjeived free training and technical Jassistancfe 
from NWREL in planning and operating EBCE. These fiv*e pro^jects are 
called pilot sites* Of^the five, pilot site^/ Hillsboro,^<5regon,. was in 
its second year X)f operation, ^hile th^ ot^tiera were all first-year sites. 
The average number of , students' ir/^ each projeqt- ranged^ between 20 i-n 
Col\^ille, Washington, and 55 in Hillsboro* The .majority of^ students at 
each -site were in the elevefVjth 9r twelfth grades with Billings, Montana, 
including several tenth grader's and Hillsjboro' incj^'udin^ ninth and tenth > 
graders. The. remaining 'two sites'were in Kodiak, Alaska, and Kennewick, 
Washington* The number of 'project staff per sit^'fange^ between* two' 3J\d 
six. Eaqji project had between 50 and 90 emplo^jer sites^arrticipating in 



i ■ < 

the program* *he median cost of operating the N>?REL EBCE" pilot sites vasi 

$1,160 fieir pUpil^or the 1975-76 school year. 

'"^ ' , ■ . ^ ^ \ ' 

Since fo\ir of the five pilot 'sites were in their fitst year of operation, 

the major emphasis in the evaluation was in assessing the degree of 
^fidelity Vfith wlii56h ea.ch pilot site .was operating.^ Lesfe emphasis was 
' placed on a uniform assessment of student outcomes and the perceptions 

of staff/ students, employers and parents ]cegarding' program. ope^alMons*. 

Therefore sane evaluation instrvraients were used. only at two or three pilot 

sites while" others were used at all' fivp, sites. • 

The major evaiuat^ion findings for the pilot sites during 1975-'76 are 
summarized below: — ' ^ ^ 

* - 1.' ^Based'on the use 'of a NWREL EBCE Essential Characteristics^ j 
' Checklist and an ,EBCE Process- Chepkiist, - four of the Hve*' , 
fif sites were judged by. the evaluatar^ to be hi-gh. fidelity'^sitea. 
' The fiftfi site used many of -'the EBCE , components and 'had moderate 
fidelity to the^^NWREL model of EPCE. ' f . 

JZ. In May 1976 students at each, pilot site cpmpleted an ^end-of- 
.year questionnaire. On this questionnaire gtuder^t^a wer'e asked^ 
^ \ to list twq'careers that they would like to enter afefer completing 
their education. Aimost al'l of the s€bdents reported working 
''at or observing one or -both' of ''the ^careers of interest to t)^toi. 
The EBCE^*9areer explorations and' learning level experiences at- 
' * ^ * coiranjunity sites were the primary influences on student career 
choices. . These experiences were also r-ep6rted by stuQents to 
- - ^ be the most important factor in changing their career preferences: 

"3. Bv th^ end of the* school year,, almost, ail of the students had 

idea of what they would be* doing after high school and the 5 
steps necessciry* ^ reach their career aspirations. 

4. While student growth on the fComprehensive Test of Basic Skills 

. was Gjenerally positive,* the gains^ in reading comprehension were 
statistically significant for only one of the fo\ir pilot sites. ^ 

5. Holland^s Self -Directed Search is us6d to aid students in " - * 
• . educational Xnd vocational planning and to peasure change in 

v6cational preferences at two pilot sites. A statistically ^ 
significant increase- over the year was ^oted in both^^pilot sit^es 
on students' -consistency scores. This score« mefasures correspondd^ij? 
of. a* student's pVimary and secondary occupational preferences with 
• Holland's theory of careers. " , ' ' 

' ■ ' . ' - *• ' ♦ 

'6. The Psychosocial^ Maturity Scale revealed at least ^smal^ po^tive 
gains^.by students in each of the three pilot sites using/this * 
\ instrument. The positive gains were statistically signiiicant 
all" three summary sciales for the second^year pilot site. 
These scales ^ere individual accuracy, interpersonal commxanications 



and^^ocial adequacy. At'bptl^ the deml^ns^ratfon' site and^at* , , ^ 
tw6 of the three pilot sites,* students showed ia significant 
gacijH in scores .relate<} to an "op^hi^ess'.tfeT ?Jtai:ige'^ scale and to* 
a '"tolerance" spale . ' \ . ' • i J 

* ' ' ' V. ■ . • ! - • ' 

The EBCE students rate^ the program high in Helping them attain 

^the program goals* ^ The goa'^ ',^'^as in jvhiph they -reported the 
program least' effective were 'in%n^|^s^nding th^sroleiQf science 
in our society/ understanding the deindgpratlc process ^hd improving 
reading and math skills. ^Students rate^, EBCE highest in helping 

.them learn to solve problems 'logically ^ vthder stand mote atxDut 

-themselves, get along with others, fit one's inte^estis'and 
abilities with* potential career^*, identify v^at to* lo^bTj' at in 
considering a job and fefel prepare^ to accept adult responsibilities 
In response to a tjuestiqn asking stqdents, "How .wouJ.-<i you. rate ' 
the overall quality of your EBCE program?," students at two pilot 
^ite^ gave ^ it a highTrrating while those "at the other sites gave ' 

.,Jtt^ a^very high ranting. , In ^innmarji^, %h& students f^lt well 
satisfied with their EBCE experience. • • , • 

A Parent Opinion Survey was used wit±i parents in three pilot/' ^ 
^ sites. In comparison wi'th pas.t experiences in regular classes, 
8S percent of the parents' felt-, t)iat their daughteiT or so^ was 
more motivated to learn in. the EBCE program aind only one parent.- 
but of 46 felt his dt her C^ld was less in6tivated to^€^ari\.< 
♦ One of the most interesting results of the parent survey -is • 
the effect the program appears to have bn- increasing the ^ 
qommuni^ba*tion between young people and their parents*. A 
.significant increase was found in- the frequency with which-' 
young people talked With their parents about EBCE as compared' 
wi'th how 6ften they talked ^ibout'wTiat was going. on in regular I 
.classes^ the year' prior to entering EBCE. " / ^ 

Many parents aJb the pilot'^'iltes s^w, positive changes in their 
son or dartighter that they telt might te a, result of participating^ 
in EBCE. Changes identiMe^by over half the parents in each, of 
three pilot sites were greater maturity o» self -direction r improved 
self-confidence and a better \inderstanding of" joBs. No negative 
•changes were reporjbed J^y parents at one site. Several p^ents^ 
at the other two sites felt that EBCE might have caused their son. 
or daughter to becjome less interested in education. * ^ 

'yhe Employer Opiaion. Survey -was completed by 111 EBCE employer 
instructors in three pi^ot sites in May *1 97 6. 'Employer ingtructpfs , 
'reported spending about" 8 hour^'a weelc working with students on 
exploration levels and approximately. J.3 hours ,a week with students'' 
on lecirriing leyels''. While students j^ere on exploration levels, ^ * 
.emi>loyer§_inost frequently indicated that they spent timi tcdking ' ^ 
about /job opportunities or activities, at their site and Evaluating 
individual, student *s.. assignmen-ts. These same activities continued' 
during ^earning levels* Over 90 percent o^ the employers responding 



/ 9 . 



to the survey '.^t^ each o£, the three j^rojects felt ^ihe progr^' 
^ staff was providing tl^em with enough^ information to 'help- them 
^""'^,1^^ direct student activities at tli6ir sites. * - . ' - 

11.' Approximately SS^pero^ent of the employers indicated that they 
woujd willing to recommend, to a -potential employer 'oi; < 
resource person, that h^ or she also Become involved with the 
E^CE program. Over half of the* emBloy^s felt that'^plpyees 

'■ — at theiy s it e bQno'fitod fiipm participat i.on w j'ttiJBBCE by' their 

'increased^ awareness of youth. About 20 percent pf 
employers also felt that participatibn in EBCE increased 'their' 
f . * ^ interest* in .their own work.* ' 

^ - . ' . 12^ ^ployers at pilot sites saw as- the grea€es€ strpngths of^EBQE' . 

' . ' * 7* . ^ , that students learn ^bout a variety of careers and. about; real^ * 

■ ' • life situatipns, and that they gain experience in' working with 

♦ / adults. . A weakness' identified Iby'approximtely 30 percent of y 

. . ^ . the employes *at each of the threq site^) was that some students 

* ' _ cannot handle the^^eedom provided "by^ the '^rogjram. In'summciry/ 

* . * the cooperating Employers were extremely supportive ofy^CB*, 

' :<> ^ Evatuitioi^f Sepa/qitel EBCE Matei^ials ' ^ ^ > ^ ) i ; • 

Tfiree s6ts*of EBOE mat;^rials Were, Packaged anfl sold separ.ately by NWREL: 
" These stand-^lone .jjacTcages of^slfSff and student materials, are available^ 

- • f without NWREL training and describe how indivi<iual EBCE strategies can 
^ ' ' s .be used in situations i where *the entire progranv is. not adopted. ' The 

I packets tested this year were, the Career Explo^pat^on Process, Student 
^ ' Competencies and. Student Care^JC Journal. '\ ; ' 

J Questipnna^res were ^ent to all districts receis^ing'^awareness' ^ets of 
. ; these materi^als to assess tHe perception of users toward -ttj^4* materials. 
4^ \ Questionnaires dealing with the Student Competencies' packet were returned 

. * jDy 25 districts, those with the Career Exploration Process by 27 "distfic^'s ^ 
and thos^ with the Student Career Journal by 28 dis.tricts* These districts. 
- ~" represenlied 16 states. Three-quarters of the respondents ^ated the three, / , 

/ ' packets asi^useful or' very useful to their students. Over half of «the ^ ^ / " 

^ respondents felt-^^would be^ easy to implement e^ch ^f 'the packets and ^ 

, ^twontljirds felt th6 |>ackqts fit in well with their instructional .activii|rest ^ ^ 
' ~ ^ .Only four 'percent of -the respondentsv a£l!er receiving, an awareness set ~ ^ . 

of materials, indicated that they did /lo^t plan to use the Sti^deht Career * 

• Journal .or the*Student Career Exploration P^oces^.-. Sevent^en percent , 
^ ^ indicated they did not plan to dse the Competencies. Suggestions' for 

improving, the tjire6 packets wili he used by the" NWREL writers in any 
• •' revisions to*. these materials. ' * - " 

. S,v. - 
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CHAPTER I. INTRODUCTION 
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k. Purposes and ContentTof Report : ^ , 

> 'This FY' 76 final evaluation jreport has been prepared, primaril-i^" to 
^ describe anc^ipsummarizle the evaluation findings for the 1975-76 school 
year o^J:he Nbr1;hwest\ Regional Educational Laboratory (NWREL) 



Exper^jP^e-B'ased Carefer Education (EBGE) Project*^ demonstration si^e^ 

- — ^ i n, y j g a td, Or e gon i i^^ d^ of the five pilot s'ites.^ ^ yhis report also 

syiranarizes the evaluation findings related to the use of sepaas'ate 
*EBGe materdaT-s. • ^ ^ • _\ 

As ,a year-end .reix)r^/~this- document .is^intelfided to serve four 
/audiences.' First/ the EfeCE operations staff may use portions of* 
this report as feedback 'to cont:^.nualjby improve their programs and ^ 
^to answer c[ues,tions visitors tijight pose', Seco;ld, ,the NWREL EBCE. 
implementation staff and practitioners considering thfe adoption of 
an EBCE program may usfe this information^ ir\ making decisions about . 
'impremfenting th^ EBCE prpgram in other -settings. Jhird; school 
district personnel in districts where' EBCE is now joperational may* 
use the' evaJ.uation rept>rt to^ becpme npre, ^sire-of* t^ p^o,gram',s- 
effects. And fj^nally, NIe; the u/s. Offipe of Etiucation .and the 
research and general education audience ma4^ use the report to help 
jem examine the -program's effectiveness. % 

♦■.The report is organized ^ntcJ four chapiters plus a separate volume 

of appendices. Chapt^t I — "Introduction"^ppfigntains a summary of 
/ tRe purposes, and contents of this rep&rt and a description of EBCE> 
j Chaptej: II-^-*'*,Bvaluation of the DemonStratiori Site" — contains a , 
' description of the pr:ogram as it operated in 'its fourth year and 
-,the evaluation results for students who h|tve participated in (CE)2 
during the past year and those who have c6mpleted two years of 
program participation. ' Staff interview Results related to the 
demonstration site's role in EBCE training and demonstration are 
also reported. The evaluation of the efjforts to impl^ent EBCE ^ in ♦ 



1- ' , ' 

The EBCE Project is described briefly on the following page. 

The 'demonstration sate'^is the original BBCE project developed by NWbEL 
in Tigard^ Oregon,' entitled fommunity Experiences for Career ^Education — 
/CE)2. ' . ^ ^ 

Pilot' sites are districts that hive agreed to use the NWREL EBCE program^ 
at their own e>qpense and receive soihe technical assistance and training ^ 
from^REL; Palot sites are located .in Billings, Montana; Colvillei .V 
Washington; Hillsboro, Oregon; Kennewick, Washington; and Kodiak, Alaska) 



NWRfeL pidQt sites and participantyoutcome results are summarized .in 
'Chapter Tn;i7-"Evaluation of Pilot -Sitea^" . ChSpfier JV contains a' 
sumirtary and' discussion of findings related "to the- use of separate 
EBCE p^pkets and- the EBCE handbooks. The appendices contain the 
tabulated responses t© various questionnaires ahd the narrative 
r^jJorts of the demoAstrafibn ^ite and second-year pilc3^t (^ite, 

r ' ' . • - - • ~ 

Description of EBCE . ' - ^ 

Exp4rience-Based Career Education (EBCEJ is "an operational expression 
of the conviction that a comprehena'ive. curriculum exists outside the . 
walls of the school. ^It assumes that the educational environment can 
be restructur;ed' to take maximum advantage of both the value of direct' 
experience and the special capaBilitie^s of coiranunity institutions in 
helpjgig young people prepare for adult responsibilities."^ 

A primary goal of the EBCE* program has been to integrate a student's 
)aiowledge of a variety of careers wi€h tiie acquisition of cognitive, 
interpersonal and affective skills through a series of planned , 
experiences with identi-fied learning-eiWcomfes Emphasis is pladed 
on th^ assumption of responsibility by the individual student for 
his or -her: ^wn ^learning. ■ ' r-^^ . -^v | - ^ ^ .j^.y ^ > ^ j 

Four characteristics, taken together, make EBCe" different from other 
alternative or career education pirbgrams: ^ - _ 

1. The learning program evolves from adult activities in the 
community. It is reasoned that if the^ learning activities 

- are based -directly « on _adlilt tasks and roles, in the comm\inity/ 
learning vail be recognized a3 more^ r^elevanfe by youth^ in" ^ 
preparing for the transition to adi:^thood, ^ 

2. The program is based on experiential learning> actively 
invblving stud^ts in the daily work of dommunity life. 

This '/hands-on" approach to learning has^long been recognized 
*as an' effective learn^g strategy and EBCE is att;empting to 
i implement thi's appr^^Wi in srcompi;ehensive program. 



Hagans, Rex W. ' "What is Experience-Based- Career Education?"',. Illinois 
Career Education Journal ^ Spring 1976, 33:6-10. ^ ' ^ , * 

A 12-page program overview of EBCE is available by writing to Career 
Education Program Director, NWREL, 7iqiS.W. Second AVenue,.*Portland,^ 
Or^goti 972(54.' This' overview describes, wh&t is unique about lEBCE, what 
sl^udents learn, -how they "learn and how EBCE relates^ to^the employers 
and the community. ' ^ ^ * * ' 



. t 



i 3. The curriculxim of EBCE is fully integrated* Just* as 

salespersons do n^t think of .i:h^ir interactions -with ^ . . 
people strictly in 'terms of granmiar/ vocabv^ary or' 
psychology, the EBCE curriculum also applies Wo artificial 
distinction among the "disciplines," ^ 

4. EBCE i&^a .fully individualized program. The learning goals 
y as well as the'learning strategies are^yeiried to 'meet the 
needs^, inter^st« and abilities of each students. 
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CHAPTEJ? 'II. EVAl^UATION OF THE DEMONSTRATION SITE 



•A. . Description of the Program and Students 'v. ^ • 

Community Experiences or Career Education, (CE)2/ is oj\e of four 
'"Experp.ence-Based -.Career Education (EBCE) 'programs being demons;trated 

under the auspices. of the National institute of Education. Operated 

in .Tigard, Oregon, by a nonprofit community corporation, the-program 
I is directed by th4 Northwest Regional E<fucational Laboratory (NWREL) * 
- Completing ^its fourth year of oper^tion^ in 1975-76, . (CE) 2 was con\posed 

of approximately 60 high school juniors and seniors and 7 professional 
. staff members providing a comprehensive high school education through 

experiences ii\ tfie community.^ ^ - 

Students in-(CE)2 spen^ approximately half their tiiie aij?*;^ leairning 
* ceAter in a one-stc^r^^ professional office complex; the- remainiilg* time 
is spent at .various eSnployer arid' community sites. Upon completing the ^ 
program's gradiaation requirement,* <C?) 2 st;udents are granted a Tigard 
Hi^gh' school ^dip!tp^^ is ^ 

available on request from NWRELr*^ ' ' ' ^/ . 

'■ *,. . . - ' ■ . - . ' * 

B. ■ Second-Year -Effects ' ' ^ ,* / ^ ' 

» ' - 

.Twenty-thr^ljj^students entered the (CE)2 program last year as juniors 
and continued in the program this year, hl^ but ori^ of these students 
^ , were pretexted in Sep tembe;r 1974 and posttested ia May 1975 wxt^ the 
following instruments : « • - . 

1. Comprehensive Te.st of Basic* Skills (selected subtests) - ^ f 

5. Psychosocial' Maturity Scale (Student Opinion Scale)^ 

- 3. Self-Directed Search • ' * • • ^ 

' : , 4; i'NWREL EBCE Semantic differential ' ' 

5. Student Applic^ation/BackgrOuM, Questionnaire ^(pretest only). 

6. Student JEnd-of-Year Ques*tionnaire (posttest only)* / * 

IXiring the past year^. 14 of the students w^re ^tosttested again in ^ ^ 
May with all of ^the instrument^ exc^ept for theiNWREL EBCE Semantic 



Five* separate handbooks have been developed: Mankggment^ an(3 Organization^ 
Cxirriculxan and Instruction, ^ Employer /Community l^esouf^es . Student Services 
aild Progreu n Ev alu ation . » ' - ' ^ 



J 'T ' 



Pifferential and th^ Student/Applica€ff6n/Backgrounc3 Questionnaire. 
Of Sthe other eight students, one returned to the hdgh school at-^ ^ 
midyear and graduated from high school, two' left the program early 
and received their }iigh school diploma thj^ougR the* community college,^ " 
one moved but of state and graduated from high school, one, got ^ 
mawried and eventually took a job through her experiences at a 
(CE)2 employer site, and .three students did not ^mplete all of the 
posttes.ti.ng Cone' of these students had graduated early) . Complete 
data were available for the remaining i4 ''students and will be the 
jDasis of analysis.' ' * v ► - ' ' 

These students, were tested during the first,' eighth and twentieth ^ 
months' df program particj.pation. Since' 1:est publishers usualbly 
attribute one month, of' growth during the three aufinafier ^nth^,' the 
metrfb of 1, 8 and 18 wer^ used in a repeated measures -analysis of 
variance utiliziii^/the MULTIVARIANCE program.^ 

The reading' comprehension, arithmetic concepts and arithmetic 
applications subtests of th^ Comprehensive" Test of Basic Skill! ^ • * ^ 
(cb:B5) wer^.^sed to estimate growth J^n ^Basic skills. "-Meaijs and 
standard (3evia£ions- ^ -for^the C!]|iS-are givjen, in, Table 1. _ _ ^ - " 
Data are reported -as expandl^d .standard*, sqores arid; as graqe ^ , 

equivalents (G^.E.). * • ' ^ ' ' ' 



• UiiiyariatS tests of the growth effects w^ used for most variables 
since i:he smalf number of subject's limited^^e multivariate analysis^ 
Previous analyses were run with^sex and- grade level as additional.' • 
covariates td pretest scores. However, since -these addi^on^Qj^ ^' 
covariates added little, i^ anything, to the model 'an^ tlfe degrees of 
freedom V/ere limit:ed^due "to small- sample sizes, ^ge and grade IWel, were 
dropped tiosx further ar)alyses.' Finn'; J. MULTIVARIANCE: A generalized 
univariate and multivariate analysis of varianpe, coVariance ^nd 
regression? Version V. Chicago: National Edud^tion^l Resources, Inc. , 
Marchl972^ ^ • ' * 
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TABLE V 



QTBS Growth Scores for two-Yfiar (CE)? Students 
■ • (N=.14) ^ •. ^ 
• ■ . ^ , • - -. . ., *^*>"' 


\ 


• 


CtBS Subject . 


Test Time 


Mean 


S.D. 


G.E. 

/ 

10.6 
12.6 
13.5 




.Reading Coifiprehension 


10/74 " 
5/75 
5/76 


' 615, 2i- 
660, M 
673.-36 


95.28 
.8?. 93 . 
102. 9fi - 




Arithmetic Concepts \ ^ 


10/74 . 
5/75 
■ . 5/76. 


' 598.35 
609.00 ^■ 
, 610.36. 


110.91 
126.33 
■135.P9 


icr.o 

'^10.4 - 
10.5 




Arithmetic Applications 


- '10/74 
' ,5/75 - 
5/76 


,580.57 
' 599^21 
. 587.29 


106:20 
97.34 
109.88 _ 


9.4 . 

9.6 





students demonstrated two years' ^owth an reading comprehension 
diiring the firsi; year of ^program jJ^rticipation with one year of . 
growth :durii^ the sfeond y^air^^^^El^^ growth , approached - 

stati&tica^l ^signif icance (P=2.39', ?dP=l and 39,. p<;i3^ and wa§ 
^certfainly educationally significant. No growth w^s demonstrated 
on either . of the -arithmetic subtests. ** _^ 



The-€tudent Opinion Scale is a local name applied to the Psychosocial 
Maturity, Scale developed by Ellen Greenbeiyger . The instrxaoent is 
used to ^assess growth in nine different areas, many of which aM 
. related to the EBCE Life'^Skills goals. ,The resj^lt-s^ f rom this f • ' ^ \ 
instrument are ^presented in Table 2. . . 
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TABLE 2, 



Student Optim' on Survey Scores for Two*Year".(CE)o Students 

• -•.(N=f3) 



Sept. 74. 

Individual Subscales .Mean^- S;D. 







r 




May 


75 . . 


May 


'76. 


Mean 


S.D. ■ 


Mean 


. S.D.^ 


■ 3b.Xl 


5.69 


34.08 


4.92- 


26.31 


6.63 


30.08 


4.73 


^26^92 


7.80. 


31.77 


6.87 


25. 46 


5.87 ■ •* 


29.54 


6.45 


34.23 


3.37~ 


35.54 


2.60 


' 30.38- 


3.71 


30.9^ 


3\90 


?5.15 ^ 


4.12 • 


J5.00 


2.96 


37.92 


•^.93 


37 J 5 


3.02 


■37.^3 


2.68 ; 


36^.62 


2.29- 


p. 77 


4.49 


■ 20.23 


4.17 , 



^elf Relfance ' 33.0^ 3.6i 

Woi:k 29.00 . :4.S0 

Id^liity . ' 30.^2 5.52 

Conimunlca lions * ^'27/. 23 7 .70 
RoTes ' ' 3^:15 ' 3.51 

Trust " ' /SO. 2 3 3.56k 

Social Commitment ' 3&.31 3.43 

^C^Tange^ . 37.77 3.06 

Tolerance 36.15 3.02 

Social Desirability 21.54, 3.45 

Sumipary Scales , . , - > / - . , 

Individua^l Adequacy^ 92.62 - 11.J6 , . 84.00 ..19\27 95.92 ' 15..27 

Interpersonal ' . ; - ^ . , ' 

ComTnunicjat.ipns 9o/85 ^9,83 ' .90.08 ia.25 96. 60 9.19 

Social Adequacy T 110.23 7.15 . ^io:3i .^ 7.^1 . 109. 46^ 5.^2, ^ 

None of/ the changes on the individual subscales w6re significcint ^ 
* ^ althoucfh three scales approached significance op, a quadraTtic effect: 
"self /reliance'^ (F=2.64, df =1 >nd 36> p<.12)r- "work" (Pf=2-80,. df=l 
. and s4r ,P<11 ) and "identity" (F==3,23^ :df=^ and 36/ pCOS) • Thjs 

meanfe tfiat the scores decreased f rom ^§eptem6er ;ti> Mby of ^'^art: year but . 
. - -revyersed and showed an increa^ thi^ school year.,. ' ^ * - 

' The "social desirability" ,^caie is a "lie'^ scetle designed to estiioate 
* , the|^"fake factor" of respons^ Higher scores indicate a tendency to 

r^pond in a socially desirfODiie mcinner. There wa^% no si^gnificant" change 
on this;-fecale 'and the low scores indicate a generail tendency £or 
jstudents to iiave been honest in theii responses to this instrument, - 

These subscale scores ban also bfe. cbmbined to fotnn three summary 
scales: individual adequacy, interpersonal communications and socicil 
adequacy (Talile 2) . ^The interpersonal communicatiqns lineao: growth 
•J^^ * app>rcache^ signiJEicance (^=2.08; df~X and 36 ^ p^<16) as did qxiadratic 
growth on individual adequacy (F=S.43, df=l ^xA 36^ P<.08). The / ^ 
quadratic changS* r'ef ers-to. scores (decreasing signif icantly over the 
• first year and increasirig ageiin/ oyer the^ second year. 

Sttidies were undertaken with data at two of 'the pilot sites to * 
^ djivestigate which l.nstrmient3 were the best predictors, of program * 
' success. When invesftigating percent of projects and competencies . 

^--1- . . — 



completed, .percent of leaning center and job site attendance and ' 
- nuinber of credits ecurned,* siibscales frdm the Student Opinion Survey 
*were consistently among tihe best piredictors of success. Thus, 
although this instrument did no1: reveal much student growth, it does 
appear to be an excellent' predictor 9f program success.- 

. ' ^ • 1 ' 

. The Seir-Directed: Search developed by John Holland . w,as used to 

Td^tify "occupational personality" characteristics of each student'. • 

These six ajreas aCre realistic (e.g,, skilled trades, technical and 

some servipe occupations); investigative (^.^.'^ scientific wd^ some 

technical occ\:5>ations) ; ciftistic; social (e.g., educational and 

social welfare occupations) ;/ enterprising, (e.g., managerial and -^ales 

occupatficms) and convent ioxVlal (e.g., office and clerical occupations) 

It is also possible to calculate six other scores from thij3 instrument 
' self estimates, activities, competenciesT^ occupatiSons, differentiation 
^d consistency. The^self estini^tes scores represent^ the student^ 
total ^self rating score (?)n a seven-pb^t scale) across Vl JcxBi^ 
♦such as mechanical abilit;y-, artistic ability and office skills. ^Twp 
9f these traits reflect §ach 9$, the si^^^occupattional categories. 
Students^ rate themselves as compcired with other persons of * the seiine 
age. festivities j5ct>re 'repr^!5^n|:s ^e^staidwt-'^ total number of 

activj.ti^ across the*sii occup^'^ional^ ca-^ecforfes that the student 
says he 9r sHe likes ta do. The compejbeaqies score represents the 
total^'Tnumber of activities across the six-occupational, categories 
that' the student feels hp or she, can dp jwell or competently. The 
occupation score r^prfesents the total *nmnber of occulta tions that are ' 
df interest or appeal to, the stud^Sfc. Tjie differentiation score 
-describes the degree to which* a person represents a "pure" personality 
type. A person with y^2?y strong "social" interests ^nd competencies, 
for .exainple, is more of a "pure" type, than A'person with^modera€e ' 
"social," "enterprising," and "conv^ntioi|al" inteirests and 
competencies. This differentiation score is computed by ^i^btracting 
the numerical weight pf" the tertiaify cpde f2;om the weight of the 
primary ^code. The consistency score is an index of the interAal 
consistency of the personality. Operationally, it*describes the 
degree of compatfbility lietween the primary and secondary ' co(|e . 
. For example, a pj^son with an "cirtistic" primary code and a 
"convention^" secondary code will probably exhibit contradictory 
behavior patterns and interests and receive a low consistency score. 

Pretest and pq^ttest rrteans and standard deviations (^.IX-) for / 
siibscores ^6n the Self-Directed Search are shown ^L^T^le 3. - . * 



1 

Holland, John I^. Maying Vocational 'Choices: A Theory of Careers . 
Englewood Cliffs, N.:[. : Prentice- H*ll, Inc., 1973. 
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-TABtE.3 . ' C 

'Self-Directed Search Scores for Two-Year (CE)o Students 



Occupational Area „ 

Realistic"^' 
investigative 
At^tistiQ 

5ocidl ^ 
Enterprising 
Conventional 

SDS Suninary Scores 

Self Estimates 
Activities 

-Competenp ies » - - 
Occupations | . * - 
Differeriliation Score^ 
Cpnsisteocy^ Score 

Significant changes were not expected in scores for the six . 
occupational areas si^n^e thes^^ fadtors usually remain stable and, art 
increase in interest *in one odcupation^l area often pleads to 
^ ' decrease 'in another. However / th"^ linear -gtowljh in ^ "realistic ^ ^ 

occupations" did app2?o"ach^iqrnif icance (F=2.i21/ df=l and 39/ p^<. 15). 

•Phi totalrnself-estimates/ activities^ coimtetehcies ^nd occupations \. 
Scores were anticipated to i|vcreas§ over the ^^ear* a^ student^ gained 
a Variety of work experiences and perhaps came .to view them^lves in 
a-'more positive light: . All P ratios were minimal (F<lf) . / ^ 



Sept. 


'74 
• S D 


May 
/ Mean 


'75 

- S.D. 


Way 
Mean 


'7& 

' S.D.* 


6.07 


4.6'3 


5. 56' 


4.44^ 


5.00 


4*17 


'6.43 


?.84 


6.50 


ir.18''' 


6.29 


4.07 


8.14 


^.42 


7.36 ^ 


3.13 


6.71 


4.05 


10.50 * 


3.37 


10.50 


2.98 


10.29 


3.12 


4.93 


2.59 


5.36 


'2.92^ 


^5.21, 


3.06 


4.00 


:2'.''i2 


' 4.36 * 


2.27\ 
♦ 


5.79 


4.69 


20.76 


3.51 


21.93 


5.53 ;^ 


• '21.57 


^ 3,92 


34.57 


13.78^ 


33.29 


ii.47 


, 34.07' 


12.45 


27.00 


^10.56 


. 26.43. 


12.96 


^.28.36 . 


'^^3.6 


17. 2i 


9.77. 


14.21 


' 6^96 ' 


' 14.36 


^^7.38 


5.86 


2.44 


4.71 


2.^7' 


5\71 


' ::J.77 


2.79 


' 0.43 


'2.50 


' 0.65 


2.50 


b.63 



Increases in differentiation and consistency were hypdthesized"as a 
t^sult of students observing and trying otlt a variety of. jobs and ^ < 
learning to. discriminate more in what activities >they. like and 
dislike. There were no significant changes on these scotes. 

Growth in educational' aspirations were estimated by asjcing the 
highest level of education, asjpired to at the beginning and end of 
the pj;ogram year. The mean increased from 3.57 to 4.00 during the- 
first year but dropped to 3.79 after the secondfyear Thi? growth 
was not significant. — - * * . 

Growth in occupational'?aspirations >7as estimated hy^asking fen: the 
two primary occupational goals of each student at th6 begin/iing^ of 
• the first^ear and at the end of - each- program year, '^ese occupational 



goals , were «onve|ted^to Hpllingshead occupational codes >.which -were 
then averaged tfi?|get an .average sqjpioeconomic status level for eadh 
tijne period. The mean decreased froir\ 3.14 to 68 diiring the first 
y^ar and then, iijcreased .tp 3.21 dxiring^the second year. These 
changes, were not signif i,cant. — 



Evaluation findings for 1975-76 

JThe following Section summarizes the eyaluaJ:ion results for the 
demonstration kite located in TigarS, Or€?gon;^ A more ccmplete 
report covering these .findings is included in Appendix dt 

Sixtjr-two sttfd^rits began the program year, of which 23 wer^ seniors 
retva?^ing for their second yeaCr of progfami participation # Results 
for these second -year (SXX students were analyzed separately from ] — 
the newly- filtering first-year (FY) student^. On the average, first- 
year studcmts completed more than the required number of career 
exploratio^i activities and more -than tro learning levels. FY students 
completed^ more career explorations thdn SY students while^sV* students 
complej:^ more projects and competencies . , ' 

Ij^&ie/^area* of basic "skills, .SY ^studehts completed more'^than one 
mQnthyys growth "in reading comprehension for each month in the program 
whila^ FY students gained two months for each month of program 
participation. The^^-^ains were reinforced- by self reports by FY 
stments who ireported dramatic increases *dn' the ^amovmt of reading 
af^er program participation. Minimal^ growth pccurred* in- mathematics . 
/ . ^ ; ^ 

Botlf. (CE)2 student groups demonstrated significant growth on 'attitude 
scales measiprj.ng openness to change arid tolerance^ but the SY change^ 
was negative resulting in a significant difference between the two 
groups.'^ In addition, SY students exhibited growth on the scales of 
work" amd roles ^and a decrease on social conjmitment scores. 

FY students demonstrated positive significant growth during the ^ 
year in educational aspirations with a slight decrease in occupational 
aspirations . " . ^ \ - 

There were no dempnstrat^d gains on an instrument used to assess - 
.career interests and* preferences/ However, almost all of the students 
• in each group reported that their program parfcicipat^n permitted . 
them to* work at or observe one or both occupations of *j)rimary. r 
interest. Every student reported knowledge relafeln^fo the necessary 
steps for how to enter these careers. - ^ ^ 

. * ' , ' . ^ \ - 

^ By the end of the school Jrear all students had some idea of what • ' 
they would-be doihg one ye#r after high school, while over one- 
quarter did not knovJ^at^the beginning of the year. K.Nine out of 
every ten (CE)2 students plan to continue their education beyond 



high school. LessitMn /seven percent of the 'students' ^ere 
intere^st^, in unskjtdled occupations. ' , . " 

Students rated (CE) 2 .highest in helping them understaiid. more about 
themselves* fit their interests and abilities with potential "caree^rs 
and .accept adult responsibilities. All students — except three 
FY and one SY student who were jinsure — iSaid'that if they had it to 
do over again, they would decide to participate in (CE)2. 

Greatest program strengths/ as rated by students, were overall 
quality of the program opportunity to l.earn about occupations and 
motivation to learn. No single weakness was identified by more 
thjanr ten percent of the students. • ^ ^ • ' 

Staff members perceiv-e that greatest student growth occurred in the 
dreas of self-esteem, individual responsibility, learning how to 
learn, ability jto coiraniinicate with adults including parents, oxal 
•and written communication, basic skills,, willingness to try new' 
things and coping skills . Moderate growth, as viewed by the staff,/- 
o^urred in awareness^ of jiontr^aditional careers, knowledge about , 
the job market an^ career de6ision-making , skills. 

In comparison to the previous yea^& the staff saw further, . 
stabilization of the program, a higher proportion of self -directed 
students ^in the program, 'more effective implementation of the 
accountability system and better Coordination by the student . , 
tutoring system- Staff indicated their perception bhat ther'e was 
less feeling of a student community and less than desired progress^ 
'in integrating ba^i-c, skills at employer sites. 

Each 'staff member indicated ar wij-lingness to participate m EBCE 
training and demonstrati^on activities during" the ccxning year and 
indicated ar^as in whi<?h.they felt they could help most effectively. 



' 'chapter III. CVALUATION OF PILOT SITES . 



Description of Pilot Sites . 

X : / ' ' • 

: \ \ . - ' 

During the 1975-'76 school ye^ there were five gil^t^ sites usihg the 

'NWR£L nK^del of EBCE, A several-page despription**,of each site ip 

terms of the community/ school, studejnts* ^taff. appears in the 

individual pilot site reports. ^^Table 4;-.st^arizes ^ome impc^ant ^ 

characteristics of the five site?.- A cdhipatrative^ description is 

given in terms of the community student population;- staffing 

. pattjern» .^nvlmber and types of participating community/employer sites , 
-cuid location of prograjm facility. Of the^five pilot sites, Hillsboro 
was »in' its second ^^a^^pf operati'&n in FY 76 .while the others were 
all firs-t-yeau: sites. The average number of students in each / 
project reuiged J^et^ween 20 in Colville and 55' in 6illsboro^ Most 

» students were in the eleventh or twelfth grades except in Billings, * 
which included *spme tenth graders, and Hillsboro, which included 
ninth and tenth graders'. The number of project: staff per site 
rcuiged between two and six persons. Each project had between 50 and 
9p eni^loyer 3ites tha^ participated in^the j^ogram^ The median cost 
oi operating the NWREL EBCE pilot sit:e^wa3 $1/160 per pupil. 1 ^* 

EvsLlyation Design 'for Pi\lot 'Sites \ 

During the spring of 1975 a preliminary evaluation plan for 1975-76 
»pilot sites was prepared by the NWREL EBCE evaluation unit and sent 
to the pilot sites for their reactions. Based on reaiponses from 
several sites, the plan w^s revised and a^eed on ,by the districts. 

•The plan discussed the purposes for the evaluation,' types ^of 
/comjparison, groups that could be used,^ recommended data to be 
collected and a t^le displaying the f iinctional responsitilities ' • 
of NWREL and of the districts in the pilot site evaluation.. The 
data proposed for collection 'across sites were an EBCE Student 
Application/Background Questionnaire, Reading and Arithmetic 
subsections of the Comprehensive Tfist of^Basic Skills (CTBS),/the 
Student Opinion Scale, Self-Directed Search , EBCE Stddent End-of- 
Year Questionnaire, Parent i^uestiohnaire , Employer Questionnaire, 

^ S.taf f Questionnaire and Interview^ Student Update Sheets, written, 

^^rojects and products produced by a random sample* of five students 
from each site, -an EBCE Essential Characteristics Checklist and an 
EBCE Process Checklist. The CtBS, Student Opinion Scaje *^nd Self- 
Directed Search were proposed for- use on a pretest-posttest basis. 
Not all instruments propqsed were used by all five sites since the 
individual sites had the freedom to determine which instruments 

II they would use. These omissions will be^noted in the next section 

^ which analyzes findings across the piJLot sites.- 



TABLE 4 



Pilot ^ite 
Description 



Student Numbers 
Gra^ie?, Abilities, 
Sex 



f9io fessional 
Stafc^g 



^isnbets/Ty^es 
of CocuiCmity 
Sit4s 



tqcation of 
Program FacUli-ty 



Billings 

cx.t/ of eSfOdb. 

located in 

part of 
Montana ^ ♦ 

Usii^ many of 
the essential> 
components of 
the EBCE sodel 



,25 students, Qrades 
10, 11 and 12 
Equal iaaie/femal<^ 
distribution 

S tudis n ts^-adzni 1 1 ed' 
by self-referral 
ojf' by referral by 
parefttsj 
counselors or 
administrators ^ 



1 project director/ 
employer relations 
•^peci^iist 

1 learning manager/ 
'lewuing resource 
specialist 



Approximately 50 



Part. of Career 
Education Center, 
a facility 
se£:^ate from the 
two high schools 
from which "EBCE 
students are 
drawn ^ • •"' 



Colville I 
Town of 4,5jOO 
in northeastern 
Washington — 
Rural, isola'ted 

ifigh degree of 
fidelity tg 
model 



20 studeitts 
Grad^ 11 and 12* 
Cross section 
Equal roale/fen«kle 
distribut ion 



, 1 half-time staff 
person combining 
rples of progras^ 
director, 
learning" manager, 
employer 
rel^ions ^ 
specialist * 

1 fullrtime aide 
functioning as . 
learning manager 



Approximately 65 
em{>l oy ef /cocBimn i ty 
sites 

Broad range 
{including ^ 
forestry service 
an^. Spokane 
a2j;port)^offei^ ^ 
nearly 3pO carriers 
frott sheep sheai^i^g 
to mortician ^ 



1 



' 1 room in junior • 
high sch^l 
building 



Hillsboro 
Town of 19,000 
approximately 
'30 miles west 
of' Portland 

Hi'gh degree of 
fidelity, to' 
model 



55 students, 
pGrades 9 to >2, 
Some potential 
drop-outs 

Three-quarters 
were males 



20\ pr'oject^ 
director time 

1 learning manager 

1 comunity , 
coordinator 

1 student 
coordinator 

2 aides 



Approximately 50 ' 
employ er/communi ty 
^sites— broad range 



2 rooms in senior, 
higJi. scjwbl 
build^g 



KenneVick 
City of 20,000 
located in 
Mid-Columbia " , 
Basin of 
southeast^ 
Washington 

High degifee 
of fidelity 
to model 



30 students 
Grades 11 and j/2 
Cross section . 
Equal male/female 
* distrib\!ftion 



1 part-time ' ' 
■director 

2 learning, manager/ 
employer relations 
specialists 

1 learning resource 
specialist 



"Appr'^^timately 90— 
broad range ^> 
i/icludmg agricul- 
ture, transpor-ta- 
tion, jfood 
pro9e33ing, 
Hanford Atomic^ 
Plant, • ^- ' 
construction > 
industries *> 



Office space in 
downtown prof essiona3 
ofjfice building ' 
(program draws frcfc 
two high/schools) / 



Kooiak 
Borough of 
df^OO located 
on an island 
off the 
southwest 
coast of Alaska 

High degree of 
fidelity to 
model 



30 students 

Grades 11 and 12 

Cross Section 
■» • 

Equal male/female 
distribution 
Ethnic mix 



1 jiroject director/ 
employer re'lations 
.specialist ' 

1 eniployer relations 
5pecialist/student 
coordinator ' 
»2 learning managers/ 
leairning resource 
specialists 

1 secretary • 

1 tutor ' 



Approximately 70 
wi^ib 120 employer 
instructors 

Broad range 
including^ Coast 
Guard 



•Separate building 
on high 3ch<»l 
campus 



- * 20 



The-m^%f emphasis ^in the' evaluation of pilot sites for 1975-76 was 
in assessing *the degree of fidelity with which each pilbt site was 
operating comparisdn" with the model described. in the NWREL' EBCE 
•handbobks * ^ . » . 

' . * * ' - V. . . • ' " ' o • ' - ' ' 

Two checklists' were used by NWREL at tfie beginning ,and end of' the 
1975-76 schdol year to determine the ^xt^n4: to which pilot sites , 
were operating" in a manner consigteht with thevNWREL model of EBGET. - 
"One Checklist, the EBCE Ess^tjal Characteristics Checklist, ^zovelrs 
five component areas of the progr^. Th§&e components , are that EBCE 

1) is an individualized prograitt, 2) is a coinmuni1:y-based program,. ^ 
3) an experience-based progtam'and is, biiilt f rom the^ career 
activities 'of adults, 4). must have Its own - identity and be 
ccxnprehensive and integrated' and 5) places a major emphasis on the' 
ca2:aer development of ^udents. Each Somponent^ area, contains from 
four td six essential'^characteristics. ^ These characteristics are 
rated on a scale .of 1 i:o 5 witii the^anchor points prespecif ied . A , 
second checklist, the EBCE Process „ Cheqklis,t,;isHrijitended to complement 
the EBCE Es^ntial Characteristibs JChecklist and was al-so used at the 
beginning and pnd of the 1975-76 school year. ^' . • ' 

Whi3^ the Essential .Characteristics Checklist identifies basic policy^ 
an<^ philosophical characteristics of an EBCE site, thfe process . ^ ^'^^ 
. checklist is designed to identi"f^ variations trom the* NWREL EBCE ^ 
handbooks in procedures used in operating an 'eBCE progi^am. ' This ^ 
process checklist consists of four section's: 1) EpCE objectives, 

2) m^a^ement and c^tgahizatioh processes, 3) jcurriculum and 
instruction processes *an^ 41, student services ^processes. Each ' 
section in turn contains separate itpms. tor example,- on* the item ' ^ 
dealing with student p^oje/ts the project director and. evaluator are 
asked to ch^k those Life Skills project arrfas/xhat are a part of 

* the* pi;o9ram> to' identic whether each^roj^t' arear jls regciired or 
optional for students and to deteonnine whether, each particular 
project area is.^esign^ like that inHEhe 'EBCE handbook or whether , 
'it operates ^differently. ^In cases where a process operates^ 
differently from the .NWREL' model a description of the differences ^ 
aad rationale for ^these differences ds obtained. 



Jtnplejnerftation Findings ^- \ 

Thet' following *sections.'C and D*will presei2t an analy^i^ of the pilot'" 
sijbe findings ac:ross site3 )prganx^d by the evaluation instrument ^ 
used, ^ Information about the^pilot s^jte implementation^of EBCE ^ 
(Section C) wilJL be followed^in' Section D by* tables^^di&playing" 
1) thp ai^ragre number, of^ttraent process outcomes land days aJtfsent^ 
per, pilot site/ 2) educational and occupational Aspirations of 
^stu^^j^, 3) Self^Directed Search Results, 4) ""^tudent Opinion Scale 
data, 5) analysis of student written projects >^v^nd, products / 6) finkiti^s- 
from the Comprehensive Test of Basic Skills and 7J .qu^tionnaire ' 
results from Students, employers, parents a/id ^taff.^^hroughout 
thesq^xtwo sections of the report the designatS^oh, of eafih site has 



been disguised to protect the ^confidentiality of findings^py Omitting 
the site names* ^and* substituting sequential letters of f:he alphabet. , 
l^he^^ame , fetter represents a different site in different ifaOles. This 
has been' done since the purpose of these tdples i$r not to rate' oTTe 
site in coij^rdispp with others but ratheif to describe certain patterns 
that may exist across sites. - . ^ . ^ • 

Ratings by the evaJuators.on the EBCE Essential Characteristics 
'Checklist for each of the five pilot sites cire displayed dn Appendix 
A t'o this report. The ratings cire consistently' high for foiir of 
the five sites while the fif^h site received four low ratings 4, 
(below 3 on a 5-point scale) The pilot sites^ rated partLdu^arly high 
on the following dimensions: ly EBCE. is. an experience-bksed program _1_ 
and is\ built from 'the career activities of adults, 2) the EBCE - 
pro'grams ha ve^ their own^enti'ty and are comprehensive and integ2?ated 
and 3) the EBGE prograpis* place a major emphasis on the career 
devel6pment of sti>dents^' In ix>mpal:ison with the' NWREL EBCE 'model 
the pilot sites were generally rated lower in providing regularly 
scheduled employer^ instructor ttairiing/development activities. 

The EBCE Process Checklist was completiid by each pilot ^site project ' 
director. A tabulated Nummary of their responses is located in . ' 
Appendix B. All of the EBCE student outcome objedtiveS contained in 
the^^JNWREL EBCE handbook were considered appropriate-' for all- Students 
at each of the five pilbt sites with only a few exceptions. Two sites 
felt that a "knowledge of sooUal, governmental and economic issues 
"and trends in the world^«oE ^ork" wer^e applicable only to *som^* but 
not, all of their students. One site felt that the outcome related 
ta students becoming "aware* of the level of B^asic Skills needed *to 
enter careers^ of interest and*- understanding the relationship qf -that^ 
level to their current, Bessie Skills proficiency" was applic^le only. 
*to some students-A • ^ ^ • . \ . ; 

' ' ' ^- ^ 

, Th5%tatf f roles of project director, learning manager and employer 
relations specialist w^gj^ used at eatih.of -the f ive'-^ites . * Aides 
were use(J at four sites, the student .coordinator ofole at 'three sites, 
the learning resource specialist' at two sites and learning assistant^^^!^ 
at two- sitesT • . 

The 13 competencies identified a^""^xamples in -the NWREL EBCE,.* . ■ ' ■ 
handbook *Vere lisedVwith some, pr all students- in* all sit^^ .^vi^ o^ly 
^a few exceptio;^s. One site had dropped the competencies^iiiealin^ ♦ 
with "budgeting time and* money effectively"' "responding ai>propriately 
feo^fire, police* and physical* health emergencies";' and '"o'peratirtg 
and maintaining, ^n 'automobile." ,-New "^competencies introd&cqd at ^ ' 
sites were *cooking, basic* swimming, basic'first aid, using* a 
newspaper, parlig^entciry prdce^res, ability to jjiake fu^ral • 
arrangemenrts and survival swimming. \[. , - 

All ten* student projects were "used with some or all studentsF^at ^ 
each bf the five sites, except for^ne site which did ^not' use' the 



science preprepared j^oject. That same site required only the - 
critical thinking preprepared project .for all students. Four of 
the five sites expected students to complete ten projects per ye^ 
while the fif1:h*site required five completed projects. Students, 
and ^taff at all five sites cooperated in selecting project topic?, 
determining the objectives and activities and evaluating the results. 

Career exploration packages were r^uirei^.of all students at all 
five sites. 'Bach site required -students '^to' complete- a, mimimum of 
five career explorations per year. Sites were .selected jointly . 
students and staff. The averagfe length of. these career explorations 
at* job ffites'^was eight hours for one district, nine hotu:s for three^ 
districts and ten hours for one distxict*. ' . , ' • 

Learning leveXsz at :thf ee sites were. required of alL students and 
wer^ optional. at .the other^two sites. Students * generally spent * ^ 
between four and'^'six weeks on a learning" level at employer sites. 

student-written journals were required of students at all five^ 
sites. -Four of the five sites Hised them primarily to help students 
know tKemselves better and to develop trusting Relationships with ^ 
an adult. \ Students were requir-ed t;o. write journal entries^ daily ^ 
at one site and weekly, at the o^her four sitel^. For a suttSnary of • 
other EBCE processes used" by the pilot' sites re^er to Appendi:^;^.B. 



Participa'^^t OutcoWe'^ Findings v . 

10 th\s section studient outcome firidings across sites will be 
presented first/ followed by questionnaire results from students, 
employees, ^parents and staff -rTable 5 'displays the average nuiQber 
of student 'explorations^ learning leyels, skill building levels> 
projects and conipetencies completed plus the av^r^ge number of 
days« absent. For cpm{>arison purposes data are^al^o presented for ^ 
the first-year. aj;id second-year project students at thdu.NWREL 
demonstration site in Tigand, Oregon. Data displayed in Table 5 , - 
are based' on 6hly thpse ^tiidlents per site for whom cpmplete pretest 
and posttest data were, available; E:j:c6pt for Site D which had 
only five students with complete data/ the. number of students for , 
whom dfita were analyzed ranged from J4 at one site tot 26. at another 
sxte^ Cro^s siti|f|vComparisons are not^ appropriate because Of the 
differences in student characteristics at the dif f^rent ^ites. 

Students in all, but two sities aver'aged completing fiye or more- * 
_ career e:^lorationfe/ which jwere the mxs^saal target level ^for the' 
year. The average numbet of learning^levels ^successfully completed . 
^ each site ranged from 0.4 'to 3.0. ' -All ^ut Site D and first-year 
students at Tigard had at least' one student successflally coijplete a 
skill builciing leVel. Students averaged completing ov^r eight 
proie'dts at each site except for 'Site B Where students were expected 
to complete only five projects,., gjh^ ^v^rag^ nvonlJer of days absent 



TABLE 5 



. Average Number-of Student Process .Outcomes Completed and Days Absent Per Pilot and Demonstration Sitev * 

.... . , ^; - • • 



SITE A 



SITE B 



SITE C 



SITE-D 



SITf E 



TI6ARD FIRST 
YEAft STODENTS 



TI6ARD SECOND 
'YEAR STUDENTS 



Car^er^Explorations 


■ 5.32 ' 1.43 


10.08. 3.10 


3.47 1.06 


\1.20 2.68 


5.43 1.09 


1^.12 3.37 


6.43 , ' 2.^ 


; Learning Lev^I^. 


^ 3.06 ' 1.48 


2^50 .99 
-J— 


; 1.20 . '.56 


.40 .89 


J.. 36 0^08 


2.24 > .90 


^ 2.29 jpi .91. 


• * Skill B\iilding Levels - 


• OS .21 


,.54 .76 


,93 .26' 


0 Q 


.07 127 


r- 9 0 . 


.29 .47 


,Pro jects 


8.77 2.52 


2.77 1.63 


^'9.20 '1.32 
' — ■ ^ 


8.20 '4.60 


9.00 1.<J 


^'.65 2.64, 


10.64 y^2.56 


""Xoinpetencies ^ ' ' 


'7.50 »3.29 


2.35 "1.52 


9.07 4.15 


9.20 -5.17 


6.93 i.oq 


'8.82. 3.28 


5.43^ 2.82 " 


Days At>sent • 


10.47 ,8.71 


1,8.2^-12.23 


• 

14-. 33 10.99 


11.00 11.38 


10.07 4,53 


15.35 11.19 


16.^6 12.80 . 



per site indicated an average attendance rate of .90 to ^95 percent. 

In Tabl^ 6 the expanded standard scores, aijd grade equiv^fents aire 
shovm for the four pilol sit^s that used- the . CCTCipnehensive Test of 
Basic Skills (CTBS) <^le"tiie .growth on , the CTBS was .generally ^ 
positive, th6 gaifts in reading comprehension were statistically 

' significant. for only one pilot site* Educationally sigrtif igant 
gains in* reading .com^ehension (at least one m^^A's growth for 

^ each month of program participation) were^dvi^^t ^or vthree of 
the- four pilot sites and* were evidefffc on arithmetic 'Concepts for 
one pilot site and on arithmetic applications for two pi^lot sites. 
Low test scores for Sii:e B are attributable to the^lowei: grade 

* levels aftd ability of students enroll^ in^that project. 

* * \ ' * 

• Table 1 shows' the ^results of the Self-Directed Search (SDS) for the 
, "the two pilot sites that^used that instrument on a^jpretest-posttest 
basis and foi? the demonstration site. .This standar:dized instrument' . 
was developed by John Holland and^ his^ssociates ^t Johns "Hopkins ^ 
University. The iSDS is desi<^ed to aid in educatibnal and ' - ' 

u(vocati6nal plann/ng. "Based on the student's self -perceptions, 
\ abilities, backgtound ctnd interests, this instrument assigns the _ ^ 
? student^ a isummary SDS code. Each ^^tudent is assigned a prigiary/> 
^ secondary and tertiary code, plus^ scores on' other ar^s.- Except*, 
t for Site A, students showed the greatest interest in occupational ' 
characteristics^ describeff as social. - This profile is described * 
by the test author as a "general preference for activities that 
'entail the ipanipulation o^ oth'er^ to -infotm, train, devel9P, cure ^ 
.or enlighten-f-^iilike of explicit, ordered,, systematic activities 
' 'involving materials, tools or^ machines." Data coJLlectied by 
^Research for Better SchooJ.s on students- in others EBCE programs 
and in regular school programs indicate that m&it high school 
students score high in- this preference area^ -^^tudents^ in . Site A,' 
which covered grades 9 to 12 and' involved mony^iidents who were 
unsuccessful in a regular school program, showed a much stronger ^ ^ 
preference for the realistic category. -Shis cat-egory is described ^ 
by, Holland as a "general preference for acti»rities that entail the 
.^{explll^cit, ordered pr^syst^atic manipulation pt, objects, -^ools, 
Machines ^imals; a' tlislike of-neducational o^^therapeu ' > . 

abt^ivities."- . The SDS results t^nd to reflect^well ithe xfeneral 
natures of * the students at each site. ~ 

' Significant differences in pre' and posttfest scores were^ not expe^^^ 
for the six occupational areas Isince these factors usually remain 
stable and an increase' in interfest intone occupational area often 
leads' to a decrease in another IJone of " these^ differences were 
•statistically significant at the .05 level in a multivariate, 
analysis of'^covarianc^ (using pretests as t^ covariate) except - 
** for an increase in artistic preference at Site A. ' - 

\ , ' . ' ^ ^ . ' < 

^' The total self -estimates, activities, cbmpetenci^ and-^occupations 
' scores were anticipated to increase o^(pr the year as students / 
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TABLE,. 6 



Pretext and Postt-est Means and Grade Equivalents on Subtests of tHie 'Comprehensive Test 
of Basic Skills for Students",in NWREL £BCE Pilot arid'Oemonstra^tiwi Sites ' , 



SITE A 



siVe 



E B 



SIT^ 



SITE* 



TI6ARD FY 



CTBS SUBTEST 



MEAN 



G.E. MEAN 



G.E. MEAN 



G.E. MEAN 



mEAN 



G.B- 



TIGARD^SY 

MEAN^' ^ G.E. 



~ — '' — ' 1 

teading • Pre 

^ "Comprehension Post 


592.00 ^9.8 
5 85. DO 9.6 


513.42. 7.0' 
53-7.15* 7.8 


661.2 12.2 
679.4 13.1 


690.67 .13.6+ 
702.00 13^6+ 


S99%1 lO-b 
>644.53 11.8 ' 


660.14 ^ 12.6 
673*36/ 13.5 


Arithmetic . Pre ^ 
• Ooiicepts Pdsty 


*JSi5-.00 . 8.9 
562,0b -9.0 


.508.35 7.6 
534-88 * • 8.1 


589.6 10.1 
573.4 9.6 


603.8^7 10.2 
643.20 12.0 


feu, 71 10.5 
620.24* 10^9 


609.00 10.4 
BIO. 36 -10.5 


'^s^ ^ 

Arithroefeic • ' Pre 
ApfJlipations .Post 


568. op .9.1 
562^00 . 8.9_ 


516.58 _7..4 
539^08 ^8.2 


^566.0 - 9.8 

564.6 9.8 

* — 


575.33 '9.3' " 
630.00 .11.1 


601.41 10. 1 

613'.24 10.5 

( > 


579.21 ' 9.4 
587.29 9.«l 


Lar^guage Pre 
Express'ion , - Post 


J 


» . ji 


64lT8^12.5 
647^8 13.0 


62*9.07 11»4- 
647.73 ;i2-.6 







T 



>=p<.05 
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TABLE 7 • , 

Pretes,t "and Posttest Means and Standard Deviations for Students in NWREL EBCE 
Pilot and Demonstration Sites on the Self-Directed Search . 



>4 




OCCUPATIONAL AREAS 



SITE A 
MEAN S\D. 



^SITE B 

MEAN 5,6. 



TIGARD FY 

MEAN S.D. 



TIGARD SY 

E^N 



, Realistic , Pre 


10^76^ 4*53 
IoTSK 4*29 


7.18 ' 4.08 
7.09 4.71 


6.82 4,69 , 
5.88 4:91 


5.86 4.43 
*^'.00 ' 4.17 


Investigative a. Pre 

^ Post 


6»65 ^^81 
6*92^ 3.07 


* 4.73 2.64 
5.82^ 12.99 . 


6.24 . 2.70 
5.29 2.82 


T7 : r-r* 

, 1^-50 ' 3.18 
6-2^ 4.07 


' ' Artistic ^ Pre 

- . - * ... Post 


6.50, 2.97 
6.58* 2.98 


7.82 3.49 
' 8.32 3.75 * 


i 

. ,8.12 3.22 
^6.76 ' * 4.09 


1.36 ' 3.13 
6.71 4.05 


Social * Pre 

Post 


8.42 3.62 
8.00 '3.68 


10.55 3.14 

' 10\T7 2109' ' 


11.53 ,2.62 
10.24 J. 42 


^ 10.50 ' 2.98 » 
10.29 3.12 


EnteiTprising Pre 

' ^post 


5.77 2.52 
5.19 2.91' 


5.91 ?.79 
6.64 4.05 


6.00 2.42 
5.29 -2.14 


2.92 

_^f2\ 3.01' 


. Conventional * Pre 

Post 


4.00 2.84*^^' 
3.50 2.60- 


5.73 '3.31 
5.68 3:64 


6,00 3.57' 
- 4^41 4.33 


^ A.26 . 2.27 
5.79 -4.69 


SDS SUMMARY SCORES ^ 

iSelf-Estimates , .Pre 

Post 


21.31 . 7.70 
24.23 4.40 


24.36 ' 5.72 
26.55 6.69 


25.^3 6.07 
24.88^ ' 5.1&^ 


24.43 * 6;U1 • 
^' 24.50 6.21 


'Activities 

Pawt 


25.23 12. 7Q 
25.77 12.97 


28.77 10.38 
35.59 12.92 


31.7V • 15.81 
36.'6l^> 15.05. 


33.29 ' ' ^ 11.47 
34.07 ' 12.45 


^Cjpmpe'tencies "Pre . . 

Post 


23.46^ 12.18 
24.27 13.52 


25.27 9.-10 
31.36 11.73 


28.82 12^.90 
' 33.00/N 10.66 


26.43 J.2.97 
' 28.36 11.36 


* Occupations v Pre - 
* * ' Post 


15.85 12.85 
• 11.46 10.11 


15.09 8.53 
23.55 - 16.27 


18.35 10.94 . 
20.12 ' ' 14.10 


14.21 6V96 
14.36 7.38 


Differentiation • Pre 

• Post : 


6.27 2.60 
^ 6.19 2.56 


"5.36 2.57 
5.13** 2:55 


5.00 / 2.35 ^ 
-^.24 2.41 


4.71 ^ 2.67 
5.71' 3.77 ■ 


Consistency 

* Post 


2.31 .79 

2^46* XsxV 


2.31 .65 

• ' 2.55* .60 

t • • f • — • * 


2.06 .83 
2.29* .77 


2.50 .65 ' 
2.50 .65 



'=^><'.10, *=p<.05, **«?p<.oi' 



35 



36 



gained a variety of work experiences *and 'perhaps came to view' ♦ 
theniselves in a mor*e positive ligHt. Posttest results generally 
showed an increase in Jbheae air^as but the- changes were not 
statistically significant. * ^ " ' 

Increases in differentiation and consistency.- were hypothesized" as 
a result of students observing and trying- out ^-^ariety of jobs ^ 
and learning to discriminate more in what activities they like 
and dislike. - 
H> ' 

Students at one pilot site showed a sigLnif icant decrease in 
differentiation thus indicating less willingness to disc^riminate 
- in trieir preferences among vario.us activities and a stronger 
inter^t in multiple occupational areas*. - At fehe demonstration 
site, hoi^ever, students tended to discriminate. better at the 
end" of the school y,ear in ^eir pref ef'ences for different - 
occupation-related activities.^ A statistically significant 
increase was noted in both pilot site^ and in first-year students- 
at the demonstration site in students' preference for occupations 
and activities that showed consistency according to Holleind's model 
of career preferences. ' rt is likely "that second-year students did 
not demonstrate si^jai/f icant growth on.t^is dimensicm because their 
vocationa,! preferences were already high in consistency at the 
l^inning of their second year in EBCE. «^ " ^ 

Pre and posttest data-on.thfe Student Opinion Scal,e were collected 
from three pilot sites. ariti from the d€&nonstrati9n site. The 
' Stu^^t Opinibn Scale is a local name applied to the Psychosocial* 
Maturity Scale^ (PMS) used to assess growth in. nine different 

'areas, many of* which are related tc^ the EBCE Life Skills goals. 
Developed by Dr. Ellen Greeenberger and Associates at Johns Hc#*cins 

.University^ the PMS is based- on biological, psychological and 

' sociological models of maturity. The scale measures ten 
variables contributing to psychosocial "maturi-ty" and yields ten 
subscores,,a total^^feest score and a measure of the validity of 
the respon^ses. Indivjiduals "respond bn a four-pointy scale from 
strongly agree'' to strongly disagree to statements such as, "I 

" believe in working only as hard as have .to." Parj^phrased . 
descriptions of the ten variables oc psychosocial maturity and 
the- validity scale are given below togetrier with -examples of 

.questionnaire items. _ ^ . 

^ 1. Work.' An individual's standards of competent task. 

performance and capacity to experience pleasure. in 
work are encompassed by the concept of work. (Example: 
"I can't think of any kind^of job that I would like a 
lot:") . - . • V 

2. Self-Reliance^ . Items pertaining to the^^concept of self- 
relictnce may address one or- more. of three factors: . 
an absence of excessive dependence on others, a\sense 
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ol^ control over one's life and initiatj^^ve. ^ (Exaihple^ 
"Yo)i are probably wrong if your friends are against ^. 
»w^t you deci^^•") • ' ^ 

' T - ■ 

\p laentity . Th^ four components of identity are 

increasing clarity of self -concept/ consideration of 
. life goals / internalization «^of values and s.ejf-esteem, 
(Example: "I change the way I feel 'and-. act so o'ften 
that, I sometimes wonder who the 'real' me is-.") 

\ . Communications , - Communications in^^lves skilla in 

"pending" or encoding verbal and nonverbal messages, , 
skillsxin "receiving" -or^ decoding verbal jand nonveifi^al 
mes;sages and empathy. (Example: '"People find it hard 
to figure me out from what I say.") — 

^* Knowledge of roles involves both an awareness of 

• obligations inherent •in^curreht definitions of 'major 
roles and an awareness of priorities that govern the 
, ^ resolution ef role conflicts • (Example: "Teachers 
. shouX^ not expect as ,mu'ch homework- from ^t^iletes-who 
/.have to spend a lot of time at practice.") • 

] Trust . Three basic attitu^s characterize "enlightened" 
, (credible)-.trust: ' general belief in the accept^ility - 
of reliance or dependency on others, rejection of 
simplistic views of the* "goodness" or "badness" of hiiman 
nature and recognition of individual and situational 
factors that limit trustworthiness. (Example: "I^^ 
people are picked* in a fair way to be on a triad jurj^, 
they are sure to reach* a fair decision.") ^ \ 

7. . Social Commitment . .The dimensions of-sbcial commitment 
^ are feelings of' "community"* with others, .willingness to , 
^igpdify or relinquish persbna^l gdals in the interest of 

social goals, readiness to iform alliances wiidi others 
' to promote social goals and investment p'f long-term 
goals. ^ -(Example: "It's not really my problem 'if my 
neighbors are in trouble and nfeed help,*") 

8* Tolerance . Toierance involves the person's willingness 
to interact with individuals and groups who differ from 
th^ norm and an ability to be sensitive to their rights. 
ItJcLXso. involves an awareness of the cpsts and Benefits 
of tolerance. (Example! "If I had a choice^ I' wouTd 
f^ref er a blood transfusion from a person of the same 
'skill colo2f as mine.") , . ' 

9. Chanq ^e . ' The change variable includes general openness^ 
to sociopolitical change and recognition of the cost's 
of both the status quo and changed (Example: . "If 
everyone is tcJ be really equal, somfe people wij.1 have . 
fewer advantages than^they have now.y) - - ' " - 



10. Social Desirability . ' (Validity Scale)^ This variable ^ 
reflects the tendency to respond in the socially 
accept2±)le way'* It. is not a factpr of "maturity"^ but 
• serves instead as a validity ^check on responses to other 
items on i:he instrument. (Example: "I have never told 
" a lier') 

' • ' ' ' ^ ^ 

Through the use of a factor, analysis, the developers of the PMS have 
designed a way of <:ombining the^ scale scores to arrive at tjiree 
intermediate scales. -These intermediate scales, more reliable , 
than the original scales, provide a useful level'of analysis -to ^ ,/ 
detect gross- attitudinal chcinges. ''These scales include: 

1.^ Individual Adequacy' . Consists of the work, self-reliaftce " 
and identity-scales* * * * ^ , • 

' \ ' ^ ' 

# Interpersonal Communications . Consists of th^ 
communication, role cind trust scales. 

Social Adequacy . Consists" of the social commitment, ^ " 
tolercince and chcinge scales. - . 

Pre and posttest m^fe^s and standard deviations for stucjents in -three 
pilot sites using ^Ks instrment and for students .in the demonstra- 
tion 3ite are shown in Table 8. 




Small positive 'gains were generally "shown by students in each group 
The positive gains were statistically srignificant* at the .05 level 
^on four of the nine^basic sub^cales for Pilot Site A. Sepond-yecur 
students at the demoiistration site "isTiowed a statistically .significant 
increase in scores on the work and the'Troles scales and -a significant 
decrease on the social commitment, change and tolerance scales. Part 
of these changes may be attributable to the fact tha'E^stu'dents at 
Site A were generally low in each of *these areas at priest time 
whereas those in theii: second yea-j^^t the demonstration sit'6 were 
gen^erally high already at pretesf t^he*. It is also interesting 
to note iti Table 8 that three of the zi^e groups showed a signifipant 
gain on the openness to change and on' t\e' tolercince' scales. 

Changes were recorded in educational aspirations and in occupational 
aspirations of students over the year in two pilot sites and for 
fixst year students at the demonstration .site. Changes in educational 
asjairations were obtained by asking students on the -background » 
questionnaire and end-of-year que^ibnnaire to select the highest 
level of education toVh^ch they aspired. These we're coded on a 
six-pgint scale with "1" indigating "don't plan- to finish.^high 
school" and' "6" Indicating^ "graduate or prof essional "tjfaining beyond *\ 
college." Changes in occupational ast>irations «wer4^^determined by 
asking for -the. two primary occupational goils of , -each student at 
the beginning and end of the program year. These occupational goals 
were converted to Hollingshead occupational codes which were then 
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' Prestas^t.^inck Posttesjt Means and St^andarci Deviations for Students in NWREL EBCE 
^ ^ Pi.lot and" bemonstration Sites on the Student Opinipn Scale-''^ - 
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^ Self -Reliance 



Pre 
.Post' 



• 26.81'-, 4.42 
28.31** 3*40 



32.68 
31.77 



5. 391 
6.09 



30.87 
32\^7 



4,. 16 
4.38 



3i.cto. 

'32.47 



6.03 
6.19 



'31.X)0 
34.00^., 



5^3. 
4. ,74 



'Work. 



Pre 

Post 



25.73 5.5% 
24. 92^^ ,5.27 



2 7.91 
28.^2 



5.50. 
5.91 



29100 
27.60^ 



4.38^ 
4.39 



26.24' 
28:59 



.5.68 
5.14 



25.57 . 
.29.07*- 



6.^4 
5.90 



Identity 



Pr^ 
Post 



24.35^ 6.20 
25.54 5.00 



29.82 
29.91- 



5.47 
7.28 



~9r 

28.93 4.5L 
29.-87 \'4.82 



27.65' 
29.94 



5.43 
6.66 



26.57 
31.5.0 



7.61 
6.68 



Conmuni c a t^ ons 



Pre 
Po^t 



2f. 

22. 



2mm 



.10 
.90 



25.59 
27.13 



3.78 
6.38 



24^93 • 3.67 
26187 - 5.8' 



2*7.59 
29.18 



5.85 
6.-55 



25.50 
2^.36 



.5,63 r 
6.23 



fioles 



Pr^ . 
Pogt 



31.46 
31.5(\ 



5.54 
5.59* 



33.09 
29.55 



4.72- 
'6.49 



33.27. 4.17 
33.27 -.4.77 



^!2T4i 



.4.85 

4:95 



,34.36^ 
35 .'14*^ 



Trust 



Pre 
'pfest 



27.04 4. 10 
27.46** 3. §7 



28.32 
^28.^8 



4.25 

3p66 



2 4.40 4.72 
26.53^y>6.03 



28.29 
29».B8 



3.5i 
318? 



30.64 

30 186'^ 



3.27 
2.91 



' Sobial 'Coininitnient 



Pre 
Post 



;30.27 
31.15 



40 
08 



1^33.59 3.49 
"2.86 5.51 



32.27 



5.05 
4.74 



S3. 00 



5.00 
4.62 



35.43 
33.86* 



4.08 
5.14 



Change 



Pre 
Po6t 



32". 04 
32.12* 



5.35 
4^87 



32.55 
32.41 



;4.%. 

5.96 



36^60 - 3.83 
35.07* 5.46 



34.06 
36.00** 



5.88 
3.67^ 



38.14 
37.57* 



3.86 
3.08 



^T61erance 



i>re 

-Post 



•34.62 5.63 
. 34.7'^* 5.08 



t35'.6t4.' 6.0'2 
^4.32 6 . 45 



^ Social 'Desirab4^1ity Pre 



18. 73- 



Post 19.31 



3.82 
• 4.04 



21.05' 3.61 
22.13* • 3.26 



36.60 '4.7© 
"37.53^ 4.76 



36.24 , 
37.76'* 



5.54 
3..70 



37.7a 
36.64* 



2.21^ 



21. 4q 3.54 
20.87* 3.31 



22.35 
21.29 



3.14 
4.13 



19.65 
20.07 



Q 4.34 
. 4,04' 



SUMMARY SCAl^ ^ 
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averaged to ^et an average occupatibnal statys" level for each tune 
period. . ^ " ^ . ' ' - 

Results of the pre and post' classificatj-ons 'of -educational and 
•occupational aspiration ♦le'v^els are .displayed in^T^ble 9. Students 
in .their' first year at the demonstration site showed a ^statistically 
s.ignificarit change indicating an increased interest »in,.obtaining 
more advanced training. , Students in both pilot site§ showed a^ 
' signi'f icant chailge, indicating an increased interest in occupations 
tjiat were lower in socioeconomic status. - Scores were relatively- 
homogeneous across sites^ < - >^ 



Student-Written Projects. and Products^ ' ' • ' 

Ih addition to the evaluation data collected and reported for all 
project students; the NWREL EBCE^ evaluation \init ctlso requested 
tjtj.at EBCE'Sitek send copies of all* student-written Life Skills 
fhrojeots. a3|d* resulting products Creports) for a random sample ^f ^ 
five s±udent^. ,The selection of these five students was done at 
NWREL using^ the total 'program ^roster and a tabj.e of random nvimbers. 
Several of the initially selectedj^studerits dropped ojat of the 
program and alternate student names drawnT^ NWREL .were used as 
replacements. * Student projects and'written produrcts were collected 
and analyzed because these -projects are-pne of -the major learning- 
strategies used in B^PB ^Ijb help integrate student activities at the 
iearnijig center with tho^e at employer* and community sites. The * 
' evaluators felt that a close- evaluation of these student projects 
•arid products^ wl;iile time-consiiming/ could be one of the best-^ays 
to assess tbe" curriculum aspects of SpCE. ^ , 

/The s^tudent Jftfe Skill? projects produced )yy the sampled students- 
were read- and rated .by- a NW^L -staff member using a Student Projects* 
Evaluation For^n. The form contained twelve categories ^f or ra.ting 
the projects and five categories * for rating the writteri^ products. 
. Each rating category contained a nine-point scale and a plafee ifer 
written evalxiator comments. A tabulated copy of the individual 
and combined project evaluation forms is located in Appendix D. 

Prior to a final rating of ^ach of t!(Sese jprojects and products the 
reviewer examined the test scores of these students and the 
evaluator's interview , results to get^a feeling for the ability 
level of each student. _> . , | 

Before rating these projects the reviewer; an evaluator and a recen-fr 
Tigard {CE)2 learning riTiinager' independently reviewed and rated four 
student projects from*another EBCE' pilot site and then discussed - 
their fijidings. In ca^es where a- discrepancy ^ of more than two points 
' on an iteii^ occurred/ the raters described' the rationale for their 
choices and their interpretation of what was meant by each'sdale. 
'The discussion helped to clarify the meaning of e§ch scale. 



' 42 



TABLE. 9 • 



Pretest* and Posttest Mectns and jStartdarillDeviart^ bhs for Students \ 
in NjWREL^EBC^ Pilot anU D^onstrfition Sj,tes on fdiicationat b-"' ' 
■ / Asp.i>afeiana,and'0pcupat1ona1 Aspfi^atibns ^ ^ 

Site^A. , y ^ Site B- \ Tigard FY 1 







M 


S.D. 




S;0. 




S.D. ^ 


Educat'ipnal 
•Aspirations 


Pre, 
Post 


i 


2. "23 
2.53 




2.7,3 
2.29 


3.35 
.3.'7i* 


• • 

2;.27 
.92 


Qccupatiorial 
inspirations 


Post 


3.24 ' 
3.34*- 

■# 


.93 


' 5^ 3a. ■ 

3.60* 


1.05 
1.56 


J. 76 

* 


2.90 • 
2.48 










V , ' 









V 



?ERICii_ 



V . -ft' 

1'' 

43 ' . • 



0 



33 



A tojial of 39 preprepared projects and' 42 individually negotiated 
projects w6re rated by^the NWREL rater, 'fhe ratings for most scales 
varied V^LdeW^ across student projects! Student projects were rated \ 
the-Tiighest in- 1) capitalizing on .student 0:nt^est; 2) productive 
Ifse Qf the employer or cc^dfSunity resource site- (although these ^ 
site^^were not used for'23 student proje^gts) , 3) contaitiing activities 
appropriate to the studen€^TS^ility, 4) the way in which the prp^ect. 
activities w^e connet:ted ► in a lo§"ical manner and 5) the experience- , 
based nature of the activities Student pro jects were ^ted the 
lowest in 1) meeting the specific objectives of the parti<:ular Life 
Skills area in which they w^e writ:ten, 2) relationsRip with career 
development: 9bjective's and, 3) ^coMprehensiveness. In evaluating the 
students* products (generally written reports resulting from the 
projects) it was judged .that most products communicated yell and 
had at least adequate technical quality (e.g., legibility and 
grammar) relative \o the student's ability. - * * • ' ^ 

Student End-of ^Year ^Questionnaire . ' ^ ' 

A student questi^l«wfi«;e 'developed by NWREL .was completed by students 
at the demonstration site and at all five pilot .sites in May^,}.976. 
The purpose of the instrument was to obtain end-of-year data on 
certain ^questions asked of the same student^ at the beginning ^of 
the year, to assess student knowled|fe* of job trends and reXati^d 
•information and to collect data on ^t\ident reflections about their'^ 
school/ tCE) 2 experiences! 'A tabulation of responses' to the 
^Questionnaires ig displayed in Appe^x C. ^ Since the nymber of 
completed responses from the Billings pilot site was small/ the 
percentage of students selecting each rBsponse is not shown in* 
Appendix G for that site. ' ' . 

Approximately 30 to 60 percent of jfche students using the NWREL model 
of EBCE plan-to wprk full time one year after completing hi^h school. 
Except jfor one. site which included * ninth and tenth grade students 
in the program, seven percent or less of the students at, any site 
indicated 'that they had^ no1.dea ^whait they planned to do 'one year A 
* after .completing high school. The percentawe^f students, planning s 
to piirsue some form of posj^econdary educatWi ranged ^jrom 46. for 
two groups to 94 for anotiier'^gr^iTipr--^.^^^^ ^ 

Students were asked to identify' two .jobs that they might li"kG to* ^ 
hold after completing their 'education. Approximately 97 perceht ' 
of the^EBCE students across the sites indicated they had 'either 
worked or observed at one or both of the two preferred joba^that , 
they listed. All but-"tWo percent of the students indicated, they 
had ^t least some^'id^ea of -the steps jiecessa^y *to 'prepare for and 
enter the job th^ most preferred and a third -of the students 
indicated the stej>s were quite cj.ear in their mind. 

* ♦ • * . 

When asked what influenced their choice' of potential careers the 
niost frequent responses selected by students in e^ch of the EBCE 



sites was their experience iii'o^seirving or trying put jobs. The . 
second inost frequent response •selepted-jt/as ^talking with people 
who work^at the jobs. Reading cLlxm<,.^^job$ .or talking with teachers ; 
relatives an<J> friends about care^ choices were fe^ less^^important 
in influencing these students'- careed preferences^^ * 

Approximately 65 percent of the EBPB students were able- to4 identify 
jobs on thfe end^of-year questionnaire that seemed interesting^ last^ 
year' but lio longer matched their interests or cibilities. Ebqperience 
in observing 6r trying out the job(s) was again the most frequent 

^reason selected for changing career plarfs. , 

^ * ^. 

—The EBCE students rat^d, the program high in helping them attain the 
program goals . The goal are.as in which they r^j^^ted the program 
lecist effective (a mean tatiijg of "between 3 and 4*on 6ach site. on a 

* 5-point scale) were in ^\inderstanding the role of science in our • 

-society/ understanding the democratic process .euid improving reading 
and math skills.' Students rated EBCE highist in heTping them learn 
to solve problems logically , understand more about themselves, get 
al<5ng with, others, f irL-their interests and abilities with potential^ 
careers/ identify what to look, at when considering a job and feel 
prepared/tp accept adult responsibilities (e?ach received a mean 
rating of 'more than 4 hy each sitei^on a 5-point scale) . In response 
to a q\;testion asking students, "How vfoiii<3f you^ate the overall 
'Cjuality of your EBCE program?" student»-^n two sites gave it a • 
mecin bating of between 4 and 4.5 (on a 5-poiivt' scale) while thos^% 
at the demonstration site and in two other sites gave it a mean 
rating of over 4.5. Xn summary, '^the students felt well satisfied 
with their EBCE ejcpejience^ - J ^ 



garent Questiortnaire 

The Parent Opinion Ski^e^ was^jased yith parents *in three TIWREL pilot 
»sites- The resijlts are reportieid separately in each of the , pi lot 
site reports* Since the number of pii;ents responding to the survey 

at each site was'^small (9r 20 and 17) jio separate tabulation by 

pilot' site is contained in this repdrt. Because they^s^irveys 
were administered at the end of the program ye^, no formal followup 
was made to obtain responses from those parents who' did not respond 
to .the first request from the filot sites. Across the three sites * 
the average response rate was^^X) percent. / 



Responses^ to ^ome of the, key questions on the survey are discussed 
here. Pajrents w^re askfed how well they felt thg. EBCE program. . 
compares overall with the past schood experiences of their daughter' 
. or son. On a 5-poiYit rating scale from much worse (1) to. much 
better (5) only one of the 46 parents indicated EBCE was muqh worse, 
5 indicated the. experiences were about the same, 13 indicated EBCE 
vWas better and 27 indicated EBCE was much bettfer. In comparison with 
past experiences in re'gular classes 85 percent of the parents felt . 
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^at their daughter or ^on was moffe motivated *to -leafh in, th^ ^^^^ 
program and 'bnly one , parent ,felt his or her child w^s .less motivated 
t^ learn. 1 • *♦ ' * 

• \ " ' ■ ' "'■ 

One of the most*. in teres ting results of the parent survey ?wag, .the : 
effect the program appears to have on increasing the corfmtmication 
between young people and. their parents.* Eleven parents re'ported 
that before their son or davt^htef enteifed EBCE their child almost 
never talked with^them about what was going on in regular classes 
and nine parents said tlieir 'child talked with tttfem alnp.st^ daily. 
After their children were in EBCE for a year, 22 of tHe parents * 
reported that their children talked almost daily about what wis , 
going on in the., EBCE j)rogram and none erf the parents reported that 
the'ir children almost never talked about EBCE. The, same five- 
point scale and bipolar statements were used in each of^^iihese 
questions. A statistically significant increase was found^in ^ 
children tailcing-vithj^theii: parents about "EBCp as compared with . 
talking abput v^t was going on in regular 'classes the prior, 
year (x^ = 22*62, d£ = 4, ■p.<Coi). > 

Mcinyp^ents saw positive changes in their son or da^a^hter thrft 
they felt might be a result o£-particijating in EBCEv .Changes 
identified by over half the par^ts in each of th% three pilo-t 
sites 'were greater maturj.ty or self direction, improved 'self 
confidence and/or better under st^ding of jobs. ' No negative changes, 
^ere sported by parents ^t one site. Severar"parsiits at the — - 
other two sit:es felt that EBCE might have caused their son or. 
slaughter to become leffs interested in education. 

« 

Employer Quest ionna3.re ' ^ 

The Employer Opinion Survey was used with-EBOS employer instructofg 
in three pilot sites in May 1976. Questionnaires were completed by 
4i, 32 and 38^employers respectively for an average^ response rate 
pf_ 57 percent. -^Employer 4nBtruators reported spehd^ng about eight 
ho\ars a weeK working with students on exploration levels and 
apprdximat^ly 13 hours kj week" with students on learning levels. 
While students were on exploration leXrelS/ employers most frequently 
indicated that they gpeht time talking ^ut 30b opportunities / 
talking about activities at their site and evaluating individvial ^ 
students ' assignments . These same, actixrities pohtinued during 
learning levels, Over"' 90 percent of the ^plovers responding 
£0 the survey at each of the. three proje&ts felt the program staff 
*Was provJ.ding them with enough infonnation to^help them direct 
student activities at their site. 

Approximately 95- percent of the employer-s indicated that they* 
would be willing to recommend to a potential 'employer or resoxirce 
person that he or she also 'become involved with'Athe EBCE program. 
Ov^r half of the employers felt ^hat'^ployees at their site 



benefited from participation with EBCE by their increased awarene§s 
of youth, , About 20 percent of the surveyed' employers also felt 
that participation in EBCE increased their interest in their ovm 
work^^ ' , ' . 

Employers saw as the greatest -strengths . of ^ EBCE that students 
learn about a •variety of careerg and -abdyt real life ^situations and 
1:hat they. gain e^erience in working with adults. A Weafaftess J 
identified (by approximately 30 percent pf the employers at each 
:^of the three employer sites), vas*" that some students cannot handle 
"the freedcxn provided* by the program. For a tabulation of responses 
to eat:h ^estion.^on the Empl<^yer Opinion SurVeyi see Appendix E. 



CHAPTER -v. EVALUATIpN. OF SEPARATE £BCE MATERIALS 



Description 6f the Materials- > ~ . . 

Stand-alone packages of staff and student materials have been 
'^developed ^d pilot tested. These materials are -available without 
training and describe how individual EBCE^ strategies 'can be used 
in non-EBCE settings. Three such packages were t^ested this year: ^~ ^ 

• The Career Exploration Process . Staff cmd student 
guides, for implementing the Career exploration 

^process EBCE used to organize eacl;i student's first 
experiences at communirty^iTres~^into a logicafl process • 
of investigation." 

>^ ^ 

• Student Competencies . Staff and student guides 
'describing the major coping skills identified by Ti^ard/ 

o Oregon, ^-citizens as necessary for adult living in their 
community and how volunteer communirt:y certifiers assess 
student competence in these areas. The staff guide 
specifies a process for developing competencies appropriate 
in cuiy community. ' - V 

) ' ^ ' * 

• • Student Career Journal . > Staff and student guides designed 

to help secondary students integrate life experiences into 
a career context 'with the help of^'a staff correspondent. 

*Tn addition to these stand-alone packages, th^ EBCE evaluation unit 
also evaluated four completed E3CE Handbo'oks and the draft of ^the 
fifth handbook x>n ProgrsSi Elvaluation. 

Th'e four coDopleted handbooks describe fifom start to finish the * 
processes for planning and operating the total -EBCE pfpgram, with 
practical suggestions on procedures to follow and 4adaptations to 
make. The four handbooks are: 

• ^ Management S Organization ."^ Suggestions for program 
planning, staffing, management and community relations. / 

Curriculum S Instruction^ Explanations of the content/ 
and processes of student lesorning in EBCE cuid the resources 
a community-base?d program makes available to students*. 

, • Employer/Community' Resources . ^ Suggestions for recruiting, 
developing and using •c^ommunity sites to support student 
learning. ^ ' , * ' ' ^ 

y , '■ ^ 

• ^ Student Services . Considerations and procedures for 

recruj-ting students, orienting them to the program. 
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Responses to a questi9nnaire about the NtWKEL EBCE handbooks as . ^ 
completed by the -project directors- from the five NWREL EBCE ^ • 
pilot sites Jwere tabulated • According to these responses projectj 
directors used the handbooks anyv^ere""ffom daily to, only once or ' 
twice while employer resource specialists used them from^* 3-6^ times 
to 4aily. Learning managers tended J^vjise the handbooks either 
weekly or monthly :while--the one lecirning resource specialist used 
the handbooks 3-6 times. ' ' 



"For training pvirposes, tlie Employer/Community Resoiirces Haridtbok 
was seen as the most effective with the student Services Hcindbook 
as least 'effectivie. For reference purposes, both the Curriculum 
ctnd Ih^ruction and Employer/Community Resources Handbooks were 
seen a^ "Very Ef f ective, " with tlje student Services Handbook again 
least effective. However, no handbqpk received a measfc rating 
higher than 2 on sl reversed scale of 1 to 5 with 1 as- t-he highest 
scor^! This mrans that all handbooks were Viewed ^s effective 
tools for training 'and reference. . 

^' ' ' ~ / . - _ 

As for handbook uses, reference and implementation were the most 
common uses with^ staff orientation and inservice training receiving 
less usage. The , handbooks were 'used heavily at the beginning of-.^^ 
the year, on a jweekly basis diaring the year and 'somewhat more 
heavily at the end of the year. All users- found the single index, 
to be "extremely useful" except one who "didn't know it existed." 

J[t was .g^erally felt that the project director, should have- the 
Management and Organization Handbook , the employer :reso\irce 
specialist should have the^ Employer/Community Resources Handbook 
and the learning manager should have ^le Curriculiam and Instruction 
Handbook. It wa^also felt that these^ latter two handbooks should 
be availcJDle for general staff usage. 



recording their progress and supporting and guiding 
their growth. , . 

V • 

Evaluation Procedures . * - 

"An EBCE Materials* Packet Questionnaire was^ developed for each of ' 
the three .stand-alone packets and mailed to each^of 113 districts 
th^t had purchased one or more s^ts of materials .in March 1976. 
A f ollowup questionnaire and letter were sent - in May to those 
districts that had not, returned, the initial questionnaire. The 
Student Conpetencies Packet questionnaires were returned by 25 
districts, the Career Exploration Process questionnaires by '27 
districts and the Student Career Journal questionnaires by 28 _ 
districts^. These districts represented 16r states for each category 
of questionnaire, ^ ' . . 

The completed EBCE handbooks had been critiqued^ as , draft copies 
during the 1974-75 school year by the Tigard (CE)2 staff and other 
reviewers around* the country. A revised copy of these hsmdbooks 
was produced based on the critiques of the draft copies. In 
June '1976 EBCE Handbooks Questionnaire was completed by the 
project directors of each of the.NWREL EBCE pilot sit^ to evaluate 
the revised hsgidbooks. 

t 

Evaluation Results " * _ 

The tabulations of the three stand-alone packet questionnaires are * 
contained in AppendifX F. Of the 24 to 28 persons responding to 
each questionnaire, only 12 percent were teachers. About 40 percent 
were career/vocational education directors and 25 percent were 
other types of administrato;rs The staff 'guides for* all three 
packets were rated high. Between 96 and 100 percent of the 
respondents to each questionnaire felt that the packaging allowed 
for an appropriate quantity of materials. - 

Three-quai^ters of the respondents rated the three packets as useful 
or very useful to their students. Over hailf of the respondents • ' 
felt it w6ifld be easy to ''implement each of the packets, auid two- 
thirds telD. the packets fit in well with their other instructional 
activities. When asked if they have already modified or plem to^ 
modify the materials, 2'7 percent-indicated^, modifications to the 
Career Journal, 32 percent to the Competencies, and 41 percent 
. to the, Career Exploration Process. This supports the notion that 
whep such materials ar^ made available to educators, there is often 

desire to modify^ theiff to fit their local needs. Only four percent 
of the respondents indicated that they did not plan to use the 
Student Career Journal or the Studepf* Career Exploration Process^ 
Seventeen percent indicated they did *not^)lan -to use^the 
Competencies. * ' - 
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.APPENDIX A 

Pilot Site Ratings or> the EBCE Essential Characteristics Checklist -'^ 

(Ratings in the left hand maxgin are those given by-^the evaluators for 
each pilot site A to E.\ Ratings' are on a Hve-point scale with the 
anchor points indicated for each scale.) 

Site Ratings (for site? A to E) / . ' / ' 

A B D E. ^ . * ^ , . 

L EBCE is an individual i-zed programi , > 

A. Ongoing assessment pf st^udent needs, interests 
and abilities iri Basic Skills/ Life Skills and 
Career Development: , 



4 5.44 4 



1 1 \ Ther€ is no ongoing assessment in two cfr 
j mor;e of thesej^cireeis. / , . 



jTj Student needs, interests- and abilities are 
, continually assessed*. 

Participation. in assessment; 



4 5 4 4 _2 



*0 



Students play a passive role in t^e 
assessment process? 

St;.udents play affi active and iiivolved role in 



the assessment process. 
,C. Individual "negotiation: 



4 4 4 3 5 



0 



All projects are preassigned and not subject 
to negotiation^ 

All projects allow for negotiation between 
student and staff.' \ ^ ^ 



/ 

4 S 4 4 S 



D. * Integration * ^ . ^ ^ 

1 1 { . s There is no formalized, individucil assessment 
j and/or accountability. 

(s I ' Individual aissessment and accountability are 
^ integrated with program learning stxategies 
when learning plans are 'negotiated. 



Accountability standaapfls ("a set of^'leaming ana_ 
beh^avioral expectations for students cis roen^rs 
of the EBCE Community'") . , * \ . ' 

1 1 { There ^rfe few accountability standards* 

I 5 I Accountability standards give the student • 

« , the necessjry flexibility-to meet' basic. 

program eructations. ^ 

- • 

EBCE is a community-based program. 

A7 Community input into program planning and-- - 

. operation: ^ > - ^ --^ . . - 



No mechanism currently , exists A 

A sys^matic mechanism exists for procuring 
and utilizing x:ommunity input. \, ^ ^' ^ 

B. Role of the program advisory board : - . 

1 1 \ There 'xs no program advisory hoasc6^. 

\ 5 \ The ^ prOgr^ advisory^ board takes eEh actii^ 

role in^diireption of the program by , ; ^ 

► , providing progr^ input* 

• Cbmmunity members and student learning v - , ' ^ - I ^ ^ 

' \ V I Community member^ are not involved in^sttident 
j"^ learning activities. , ' , • \ ' . * 

. I 5 j ^Conamanity members serve sis resotirce" instructors 

''^and certifiers of student ^eaapiing. \ ^ , ' ^ 

D. 'Revision for commtoity instructor ^z^ixiq/ 
development activities: < 

tTj There are no ccxnmimity^ in^trtictor^ t'raiiJing/ 
j"^^* development activities ^ * i 

[5] There are at lea^t four, .?:e.gularly scheduled' \ 
vPOi«^^i>^y instructor trainihg/developmgnt ' 
. activities:* • ^ ^ - ' ' 



■J 



A ' * ' • \§\ te Bfiti ngs 



A B --C" D E 



III. £BCE Is an experlen^-basecr program and is bujlt 
' * fflom'the' career: act>viti€f5 of adults- 

, ^ ^Af. Mode of. learning:*- . 

^ * ^ I f { ' Students are .instructed in' a;pas^lve or ' 
J 'schoOl-like njode'. ' . ' . 



5 S ^ 5^ 5^ ^. 



I 5 Active , r^ali-stic llfeiike learning 

activities ^are provide<^ for all students, 

B. Student act'i^ 




5 5 4 c5 i 



9 , 



;1 1 L students a^?^ifeigned activities and 
vj > ^clredules . • , 

I "I - / ^ ' . ' , 

I 5 I Students have the responsibility for 

budgeting their time ^and managing' their 

daily 'sjictivitiesr' , . , * 



4 



'4^5* 4., -4 4 



Uti li'zation of - resoux:ces : 

\l\ ^condary tesourc^ (tex^tbpoks, courses) 
j are given priority . 



'primary resources (people,, institutions 
such* as libraries and museums, events) 
• / ^ :'ar<&^sqi^en<^pr£brity. . 

'Dt . Community -leapiing activities: . ' 



^:\ff Adu 



4'' 



5 "5 .5 4 5 



4 5_'-5 1^ 5 . 



Adult activities ifi the community are»not 
-utilized impudent leamiiig. ^ 



^ Isj •Adult activities' it^, the community serve 



as 



, ^ the'p^rimary <:onl:iext, for student learning.. * ^ 
E. * Reference population:" ' - ^ - 

1^1' I Adolescent peers; and school woik cire the 
\y :^rimary referent. " ' V ^ ?- 



Adults^Jl); thfe /.world ^kwork are- the primary 



referent'. 
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Site Ratings' 
A .B C D E 



5 5 5 4* 5 




4 5 • 5 • 5 5 



_.F* C<3bBunity learning £>otential: ^ \ ^ 

' , ^ rij' No •analysis is ma^ of ^the learning 
potential of the local cbnmunity'. 

^ . ^ ' I . ■ 

I 5 I ^ere is systematic analysis that enables 
- ' staff M^^^<tents to take full advantage 
* ' ' of thejtfHKin^NPot^tial of the^loifeJ. 

IV. ' EBCE must have its ovm, identity and must be 
comprehensive and integrated. 

t A. Program. requirements^ and» processes: ^ 

®<p ' . • ' * ' • . 

' jlj Be^ular high school requir^jaents and 
a \^ processes are used 'to determine student 
learning plan3. * . . 




EBCE program requirements ai\d processes 
'determine student leami-ng -plans. 



4 5-4 5 5 



4v J, , 

5 5^5 55 



I 



ERIC: 



B. Pro^cim completion requirements: . , ' 

I 1 I Program completion requirements are vague/ . 
\^ unspecified or not differentiated from the - 
It regular high school requirements, 

, ' 5j Pro^gram comp4.etic^ requirements are^ clearly, , 
^""^ Refined, differentiated from and consistent 

with program goals and J^ocal . requirements I - 

C. Curriculum: ' ' ^ ^ ' . " — 

r ' ..^ ^ t , ' ' ' ' ^. 

I I I The curriculxim structure 'ihcludes epcpferie^ces : 
\\ in either one pr none of^the following ar^as^ 

I Basic Skills, Life Skills, Career Development. * 

I J 5 | . The! curriculum structure includes experiences r 
in all of-^the above areas^.^ • • , 



f 
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Site Rati rig? 

f, • * . A* B C *6 ,E' 



5 5 5 5 5- 



[ij Ther^ are no performance-basfed svurviyal 
competenciesH. / /: , , 



5 5 4 4 ^ 



There ^are at least ten per form'9nce-;^basa<J >^ 
sui?vival competencies necessary for coping 
in life and modgrn societij. ^ " ' 4^ 

> E. Interrelatedness of 'curricvaipf and stuSent 

learning: ^ 'V^— , ^ »' / # 

[ g j -Disciplines are eii$>hasi2ed Sepcirate'ly . , 

* [T] Emphasis is cxi interrelated curriculum . 
' ^""^ areas and thi^ is de^nstrated by 
\ ' 6tude'nt "learning activities. 



The EBCr progranT pl?Ges a^major emphasis on the 
career deveTopmeat of stu^ients. < , jjB 

^ , - 'fftes pf canmtinity learning situations; 



5 5 5 *5 5 



■'5 ■ 5- ■ 5 5 4. 




L i*i *'^^re are no eraployer/coinmunity leaxriing 

js] Provision 'is made for, different -tyE>jBs%nd 
levels of learning sit^tions at employer/ 
commijpity. gites. . » 

^ B. Birphasis at- leeuirning sites: ' _ 

' > ' 'I ftudents are paid for their* contributions 
H"""^ on employer/coinmurtity sites . * / i 

I 5 I " students ^are on empioyer/commmity sites '" 
. ^""^^ /or.leeiming about careers, npt earning 

miohey . _ ^ - - 



ERIC . 
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A -5 



Site Ratings 

A B .C D E 



^^54-45 



-r-- ^ 



^ C.* ' Career Secisioa making*: * - , 

1 1 I Studejvts are not encouraged to iiqprove 
j tl^^ir c^eer.decision^making process. 

j 5 j Studehta are required to gather information 
' ^ about them'§elyef^ anS:_tiie world of yjork ^d 
• apply thi,^ information in ceure^r decision 
- * * , making. - ^ , - ' 

: \ . • : 

D. Reflections on 3tudent e^qperiences: ^ 



1 • ' 



3 5 3 4 3 



0 

I 



There; are no. xtequirements towards If r 
evaluation. \. * ' ^. 

Studients are encouraged to reflect^ on 
exgeriences and evaluate their own 
strengths and weaknesses an4 progress. ' 



i ^ 



V. 



* - p 
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> . • APPENDIX B' ~~ ■ ' . . ■ 

^* NWRELEBCE Process Checklist Findings fon Pi lot .Sites ' = 

Thi^ checklist is intended as an instrument to identify areas in which 
pilot sites 'and market demand" sites are 'consistent with 02; different 
from^e NWREL EBCE' operational* model. Deviations from NWFEL , 
J)rocedures are viewed here from a neutral perspective in that certeiin* 
deviations may produce different results thaa those described in the 
NWREL EBCE handbooks.' A 'description of w^t deviations occur, their 
reasons and ^eir resjalts is essential for an \inderstanding-of the EBCE 
ia^lementation ^effort, • ' ' , 

* .'*''*« 
Thisj>rocess checklist is designed to identify deviations in -procedures 

used in operating an EBCE program and conpleipents 'the EBCE Essential 

Characteristics Ctle'cklis-t^ , which identifies basic philosophical and 

policy characteristigs of EBgE sites. The checklist has foUr sections: 

1. EBCE objectives" * 

2. Management and organization processes 

3. Curriculum and instruction processes - ^ ^ ^ 
^ 4. Studej^t service processes 

For each itAi in the checklist, .the, project administrator is requested^, 
"to identify whether the item applies to all 'students (or s.taff , enployer 
et<?.), some or none, and alsa. to identify ^y Vays in which the process 
operates differently than at the demonstration site. 



EBCE PROCESS-CHECKLIST • 



Site 



Respondent^ ^ ^ 

Observer , ^ ' Date' 



I. OBJECTIVES. 



For each objective listed beloi/ please check whether J.t -^applies to all' 
of your BBCE' students r some or none. Also list any additional student 
outcomes that your project may have.' (Please note that the Life Skills 
curriculum area is not included here becaiise it is addressed i^n Section 
Ili B.) ' ' 



US^r^TH: 
All Some ' No 

^tudents^ Students Students 



I Career Development 



1. students will increase their 

* *^ knowledge of *'their own * • » * * a 

aptitudes r interests 6nd - _ 
abilities and apply this 
;t understanding to* their ^ 
potential career interests. 5* - 

2. Students will increase their 
knowledge of soci*al/ 

' ' governmental anii economic 

iss\j(es and -trends in the ♦ . ^ 

world of work. . ^ 

•> ^ 

3. , Students will deVelop the • ' ^ . 
' ^general 'skills of job 

finding, job application, 
on- thfe- job. negotiation and ^ ' 
•'dependability necessary in , • 

dciily wdric interactions. 5 ~ 

4. Students* will analy^se , 
'potential careers for*^* ^ . 

fin3fici*al*and psychologtical . / ^ • 

indi^c^ments, preparation ^ ' - ^ 
ne^ds and *preparatioa. . ' ^ , 

programs, available . * *5 



*Numl5ers shown refer to the number of pilot sites ^ (out of 5) resporfding 
in each .category. , / . ' 



USED' WITH: - , 
All Some No 

- Students Students Students.. 



''Basic Skills • 

— /: ^ 

5. students, vill be able to 

jperform applied' ckills tasks 
* related to careers, of ' . ^ , 

- interesff t6 them/ . - 5 

6* Students' willf inqproye in . ^ . 

their perfonftanfce level of ' 
Bcisic /Skills (reading, 
writing, oral commimicafeion ^" — 

arid mathematics ) . f ^ 5 

7. Students will ihiecome aweure 
of the level of Basic Skills 
•y/ needed^ to enter cetreers of 
. 3 interest to them an5^ will ^ 
l4_undej;steuid 'the relationship ' ^ 
I of thafe level to their 

: current Bcisic Skills ^ 
proficiency. . . 4 , . i 



8. . Students will demonstrate an 
> increased willingness to apply 
, BcLsic Skills to work tcisks and 



\ 



to avocation^l interests. ' ^5 



Other Outcomes ' ^ 

9. students will broaden the 
range of sources they use ' ' 
(people/ events, ihstituticsi 
laws, books e-tc*. ) in ^ 
gathering information for 
work' and decision making. 

IQ. Students will demonstrate . * ^ 

the ability to conduct , ■ 

conversation with an" adult , ^ 

that reveals the student's , 
self-confidence^^d ^* • ^ , , 

understanding o% the other^ * 
person's message cind ' 
feelings; - ' 5 



All 
Students 



USED WITH: 

Some 
Students 



• \ No 
Students*^ 



11'. Students wijl Semonstrate 

an increase in self-initiated 
behaviors and in assvBoing*. 
responsibility for. carryiM 
out and evaiuating--^tasfe^ 
which they, agree to conplete. 

l5r St\ad^ts will demonstrate an* 
incirease in behaviors that 
reveal a toleranc^.for- 
people and institutions 
having different values, 
ideas or ba^kgrqtind than 
themselves; an openness to 
change and a willingness to 
^ust others when 
" ' circumstances' warrant. 

13. I Students, will include data\ y 
— from their total sensory 

.system as part of thejir 
input into their decision- 
majfing processes.' 

14. Students will be and feel 
better prepared to assume 
imminent ,adult 
responsibilities and 
relationships. 

i 

15; ;-Students who select a ca±eer 
area to pursue will, acquire 
specific job^ skills while' 
at employer sites related 

f to their career areas. 

16* Other outcomes (please list) 



61 



11. MANAGEMENT AND ORGANIZATION PROCESSES 



Y 



Blease chec± the appropriate respdnse that describes the current status 
o£ your .project on 'each of the following dimensions ' ^ 

!♦ Has the district schcx^l board approved the project? ' ^ ' ' 

Approved in- writing 5 • Verbally approved Not approved 

2* Has th^ state department of education approved the pr9ject? ' 
Approved in writing • 5 , ^ Verbally approved ^ Not , approved' 

3^ Does tiie project meet all legal amd fair labor practice reqiiirements? 

' Yes 5 Meets most Requirements No ^ " f 

Clf yoii select' "meets most requirements" or "no," please- explain /J 

4. Ai^e thfe' following staff roles being iised? (Check \€hQ^e roles 
ax:tual]!y defined and used.)' • 



Project director 5 

^Learning nianager-' 5 

Employer relations 5 
specialist 

Learning resource 2 



Student coordinator 



Learning assist^t " 2 
Aides ' ^ 4 

Others (list) 



tiL 'curriculum and instruction processes 



fcA, Competencies 



Of the following competencies check those ^ if^any, that are- part of your 
program and indicate if they are being certified in the same manner as at 
the demonstration site. List any competencies your site, mag have added. 
If your site uses competencies differently than as described on pages 
331'4Q7 of the NWREL EBCE Curriculum & Instruction handbook, ^ pl ease 
qxplain the differences. 
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Iv Transact business on 
' * a credit- ba^s 



Reqifired Optional "in Handbooks Not Us^d 



2. Maintain a checking 
account 



3* ^ Provide adeqiiat^ 
insurance ,for self, 
family and possessions 

4» File state and federal 
income tax 



5. 

/I 



Budget time and money 
effectively 



^^^j^/TXMaintain the best 

^ physical health and- 
make appropriate use 
of leisure time 

1. Respond appropriately/ 
to fire, police and 
physical health 
emergencies 

« 

8. Participate in the 
electoral process 

9. 'Understand the basic 
structure and function 

^ ; of local , state and 

federal government ' : . 



> 



^ s X ^ 



10. ^ Explain^ own legai 
responsibilities 



11.. Make appropriate use 
of public agencies 

12. "^IHpapplication for Jj^ 

^gyment and*" 
Ss fully hole 




hol d 



B-6 



/ ■ 
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Used 



13, J_I?perate and maintain 
— an 'automobile'" 

•14» other competencies 
(please list) ^ 



Di fferen tl y Than 
Required Optional in Handbooks • Not, Used 



\ 



Cooking 

^ Obtain basic swimmings 
certificate 

^ Demo/istrate-pasic 
first aid 

" Read and use a > 
newspaper ' y> 

. Parliamentary 
— procedures , 

Fxmeial arrangements 

- Survival swimming 



1 
1 

1 



1 
1 



B. "^Student Projects 



Check those projects. If any, tha,t are part of your program* Idst 
any student projects your site may have added* If youiX^site useb 
student projects 'differently 'than described on pages 189-^3 of the 
WffREL BBCE Curriculum & Instiruotion handbook, j^lease explain the 
differences^ 



Vsed^ 

^> ^ . . Differently Than 

^ Required Optional in handbooks Not Used 

1* Critical thinking ' 

preprepaured 'project 5 , * 



2» Critical t^iinking^ 

individual -prbjeot A 

3. Science 

preprepated project 3 

4» Science 

individual project -^^(^ 

5 • Pe r s onal/s ocial 
^dfevelo;t>nient 
preprep^red -project 3 
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' * Used' 

Differently Than 
Reg tared Optional in Handbooks Not Used 
"6. Personal/social ^. , ^ 

i3evelopmerrt> • ^ 

individual project 4 1 

7,. Functional 

citizenship „ ' 

preprepared projTect '3 2 • 

sT" Functional ^ 
citizenship 

. individual project 4 1 * 

9. C^ative 

development " ^ ^ ' ^ 

preprepared project 3 , 2 » 

10** Creative • • 

development 

indi\^dual project 4 I . . ^ 

11* Others 



2^''How mahy projects is each student expected to complete each year? 
(Four sites require ten projects; one site requires five projects) 

3. On individually prepared Life Skills projects, whp generally does 
the follxivfing? ^(Circle responses - that apply).: 

1. Selects ttje topics Students Staff C Both J 5 

'2. Detemjines the objectives Students ^ Staff f Both;} g 
and activities " * 

3.^ Evaluates the results, / Stiadents ^ /.Staff f Both) 5% 



C- E^cpl oration Package 

1* Are the 'exploration packages — 
Required of all students 5 

♦ " ^ • ** 

Required of, some students * 

Used -differently than described ^on pages lQB-185 of the NWRE^ EBCE 
Curriculum & Instruction handbook. If* so> please explain^ the 
differences. 



Hovf many e2?>loXa«bns , if any, ane xequired i«)f students in vour 
program? ^."^^ 'r I 

(All five sites requirer five explorations^' 

Who select* th0 exploration sites for an individual student? 
' EBCE staff / ^ - , ' 

The student . J . ^ 

Staff and student jointly 5 
, Other (please specify) 

. ■ • • ■' ■ /' 

What IS thej average length of each exploratj.on in hours? 

(One site listed eight hours; three sites listed nine hours and 
one site lifted teh hours A* ' ' 

\ ■ ( * 

Learning Level Process . \ . 

;-Are learning levels — 

^ - ■' 

Required of all students 3 
* 

Required "Qf- -some 'Students' . • 

Used differently than described on^ pages 277-327 of the, 
NWREL EBCE^ Curriculum & Instruction handbook. If so, 
please explain the differences, 

* 

.Not ^required i - • • 



(One site did not respond to this question 

Hbw many learning level experiences, if any, are required o^ students 
m your program? • 

(TWO sites reported no specific rtuwber, two sites reported no learning 
level experience required, one site reported pne leariiing level' 
experience required) ' ^ , , 

Approximately what proportion of time do students sj^end woJking on 
learning le^^ls at en^loy^ sites? \ • • • * • 

(Three sited repor^d 5()k, one s^te reported 4 weeks (2-3 hours per " 
day), one site r^fcted six weeks and one site reported two-thirds 
of the prog£:am ye4rT ^ - , • 



student Journals" 
ijhat are the primary .purposes served, by* the journals? ^ - 

' ' " . - ■ ■ - ■ '■•.'/.' ■ 

Analyzing and integrating career awareness information ^ 
Developing communication skills . I 
•Helping students knovT themselves better 4 
Developing trust relationships with an adult 4 

.''Are student joum^s-*- * 

Required of all students 5 \ _ ' * • • 

R^quired^of some students ; ' ' 

Used differently than described on pages '411-451 of -the-" 
Curriculum" S Instruction handjxjo'k, , If so, please explain 
the differences. • . ' i 

iHow often .are students required to write journal entries? 
i'BfSva: sites repdrte'd weekly; one" site reported daily) , 

Itow often are students required to ^tum in their journals? 
U All, five sites reported weekly) 



Employer Seminar 



ADproximately ho>r many seminars with en^ldyers or community- resource 
people .t^ave y^u held for students or do you plan to hold this school 
' year? , ^ * * « ^ ^ . 

(One site reported one', one site reported two, one site^eported 
threj^, one site reported four and one site reported nine) — ; ,* 



Specif>c Curriculum' Materials % • , ^ ^ 

Do students in your program use the f^Xcwing materials? ^ 

_ pSBV BY: ; ^ 
Tilir Some Z'-^^, No 
. students Students. .Students 
i; Bidividualized^liefatoning . ' - 

, for Adults (ILA) Basi<% ^ , ^ 

' skills materials ^ • . 5 

•2. Career In/onQatioh System . .. ^ 

(CIS) . , 2 ^ 



1 



3; Qther Materials 
' (please specifgj. 



USED BY: 
All • Some. * J W6 
^tuden ts- St uden ts StndAi 



^ — ^ ^RA^ Basics ^Irlsi^^t&rials-^.- 



i 



' Locillg created Basic 
Skills materials * 

SpectriUm math s^ies 

^ Sounder rea'drn^ program , 

Competencies packe^ge 

District Career ' Education 
materials , . 



Occupational Outlodk 
Handbook 



X 



l^j ^ 
I 
1 
1 



1 



H. Program Completion Requirements 



0 



.1. Ebes your project have 'written program coinf)letion requ^reBients that 
^ ar^clearly defined? ^ '^^s / 5 ^ No 0 . > " ' , 



If yes, are the requirementsr m;e thpse described on pages 52-53- of 
^th« NWREL EBCE Curriculum &yInstruct^on handbook?- 

.4 No 



Yes 




IV. .STUDENT SERVICES 




A* Studervt Recru>tment-t - • ^ 

1. Has/ student recruitment been aimed at a "cfifoss -section of local , hjjgh 
• school ^students? ' . Yeg^t ' 4 ^ No* I * ; 



|2 What recrui'tmeht strategies were . usQ.d? 



' Class jneeting: _ ^ - 

^ ^-^ Programs at the high school- , ; ' , . ^* . 

- A recruiter tapie was set up in the schooX library' . - 

. " .fUsing students , harefally^^ selected, is the only really effective 
strategy^ ' ' \ \ ^ • • » 

- Referrals ^i^om' high school counselors . • ' ' >^ 
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B-II 



J 



'1 



3, Whart: types .of students actually entareS 1^e prograia? {IndicatB 
— onl^ if different from type of student recruited.) 

- Students With the widest possible range of ability and attitudes 

School dfopouts ^ --^ • ' V • *^ 



B.^ glasses 



" , 1, ffice students allowed to'^taJce classes at the local school? 

. Yes . 5\ _ Ho / 0 

. . "'^^ ^ At- community colleges /br other institutions? 
\ ' ^ Yes 2 No 2 " ' * • " * . 

- * • fone-site did (lot respond to this question) 

^y^^, 2, • ApproxiniatelJ' how many students, . if any, are currently .taking 

' . ^ classes? \ ' \. 



^(OneT'^te reported eleven, one site reported nine, ,twQ^sites , 
reported six and* one site reported three) / 

What types of classes?^ ' 

' (Sites reported classes in English literature, band, '4ril2> k:eam, 
French, history, aVt, chorus fnd ag^riculture) . ' * ' — ^ 



' Cr. Gaidance - " > "^^ " ' 

1- Is the guidance' function shared by all professional staff members? — 



Yes 



No 



2. . Do staff m^mbgrs conduct istt\dent staffing sessions regularly to 

* ^1.. ^CxL. j= 5 jjo^ 



discuss the prbglress of each student? 



^ # 



/ ■ 



p. • Accountability System ♦ , . - . ^ ' 

1. J)oes your' project xitilize a^student acfcountat)iIity system with 
clecurly defined expectations anji' consequences?^ ^ 

Yes ' 5 No 



If yes, does your accountability system wo^rk like that described pn 
pages 77-91 of the Curriculum &.Instruqtion handbook? ' . 

^ Yes No . • ^ . 

If no, please describe the differences. ^ * * . 

r *^ ' it 

- Somewhat different because of individual interpretation 

- We consider indi^dual needs and problems * . • - 

. E. Program 'Yajir Action Zones 

• How mai^' pirograguyear action zones for students axe utilized by^ ' 
your project? , . ' - ' ' ^ ^ 

*^2Wo si,tes*reported ten/ tPv^o sites reports^d etght and one site cfbes 
not use program year action zones). 

\ * * . ' ' * 

2. If you 'have ^c^ion zones, are they organized like those described- on 
. pages 81-84 of the NWREL EBCE Curriculum & Instruction handbook? 

Yes- ^3 - No 

Assessment Tofms , ^. * " -\ 

1 

» Listed ieiotv^ are a number of EBCE forms or instrtanants .sometimes - 

used. Please indicate whlcb forms^re regtured> optional oi?^, not 
, ' ' used. Also indicate if they are revised or different from those 
. , developed or used by NWREL ^ * ' 

' ' " * \ ' \ ' 

\ • » " " / * ' " * • Revised or- 

- • . . ' , ^ • * , ^ Different 

• N »^ • * C/^ed jSy,* Used .by ^ JVdt i'rGm the ' 

^ \ . ^ ■ 'AJ^* *Sdme '^Used- ' Handbopk ^ 

\^ 1. CTBS, Rdad:yig & Arithmetic ' . , 

' . ^-Subtests (C:27,54)*/ - ^ 4 ' ^ ' 1 . ' 

.-T-^r ^ ^ ^ ^ 

*!Ihis fodi is_sh?iwn-or discussed in the designate;? liWREL Este handbook 
on these pages'.^" (C = Curriculum & Instructioi ; S> Student Services) 



' * /. J * - ^ ' • ; , '» . ^ Reyispd or 

' ' . ' . ^ , . ^ , ^Different 

' * Jjsed b\^^ Used by' Nop frc^the, 
y ; ' _ s / . , " ' . ^oipe £/se4 Hajidhook 

2. Ba^ic aiills Prescr^-ptipn i ' _ 

r, P^d (C:635K \. ' ' I I " 3^ - 

r^r"^^^v r ■^•"^i^'^^'-^-s.-''".'^';; ^ ^ ^ . ^ — . ^ . ^ ^.^ ^ . ^ - - 

' . i. ' Self';D^rected iSearch - * . s I * - ' ^ 

- (0:116,145,640-41)' ' 2 ^ r\ 

* 4.' PSM (Students Opinion *•* y • ^ . ^* *^ 

' , - ..^ scale) ' • • . . ' 3 . . 't V 2 » , ' 

' • • . . , • ' , ^» - .t' ^ . ' • . • . 

, " ' * . ^ - - w,. . - ^ 

> < 5, , Semantic Differential , 2 , . 3 



' r 

6:/ Goal* Directed Student ' _ . 

'Ratings ' (by staff) I r - *2 I 

• » * ^ 

7. Parent Opiiii oh* Survey' . 3 ^ / i I 

Employer Opinion Survey t 3 • i I 



< 



, i . $ . ■ Stud^t' Application Form 

. . ■ • (S-.69-75) ' . . - ■■ " 5 

^ f * ' . • * ' id* 

' ' . nJ^^ Staff Qu^:stionnaire '4. ' ^ 

11. End- of -Year Student ^ 

• * ^ Qtiestionnaire ^ ' . -^5 

. « . 12. I^e^ming Site Analysis 

' . • - Form ^(C: 72-75) .^3 I " j;; 

. * 13. Skill Development F^cords ^ ^ ' 

. , . (S^108-109) .2 ^1. 2 



14 Studfent Performance -RiSview 
Y • \ ^ ^. -(by einployersf(S: 112-113) ^ 3 

15. Student Evaluation/ of - - 
' . Learning Site {S:yiO-m)' .2. ^ ^ 

16 • EBCE Record of Student 
Performance (S: 265-297) 
< (Portfolio) ^ ^ 

17. EBCE Student -Experiencfe ^ 
'Record' (Sj 102-104) . . 4 ^ 

* — ' 



ERIC , 



J 




^ JJL8*^ Vfeekly.TiiBe Reports 
(S: 90-91) 

19; Stiident Profile Sheet 
' . (S: 98-99 Ir- 



20. ^- Accountability Write-Up 
vForm (S:i:^8-119) 

21. . Leamingr Site Utilization' 
. " ' Eom- (3:106-107) 

22. Maintenance Visit Record 
(S:13Cbl31) 

"23* 25one Debriefing^ Fo;^ 

^(S:116-117j . . • ^ 

24* Predesigned Projects 
(C:196^) . * ^ • 



. ^ • Revised ^or 

i / * ' different 

C7sed 2>y Vsed'^bij Not frcm the 

All * ' Some ' *Used • Eandbock 

\ ■ • * ' 



' 1 



V 4 



^ 2 



2* Please list any additioadl forms or instrvaaents ydUr project uses. 



^ P^' would also 'appreciate receiving copy of any of tftese forms. 

Skill Building Level * • 

1. ' Will^Jdll building levers' at^ ^i^lpyer sites be — * , 

' ' ^ RBqSiice^-oY'^all s^^S^tSttts^t^^^^^ - * « . ^ _ 

Required of some students?' 1 ^ '"-^/^---===^-==«ir*;^ * < 

Availably as optiOT? 5 — » - , ' ^ *. - 

Used differently'than described on peiges 277- 327. of the^ • " 

Curricultan \ Instrucption handbook? If sp/ please explain 
the di'fferen,cas» »• 

2. ** if^ikill building. J.evels are in intended peart of your program/ •ha^fe 

any students Be.gun them yet? * * * % ' , , 

* . Yes 4? . - ^To i . , ' . . / * . ' 



W. Special Placements . . \ 

1/^ Are "special placements*' of students at en^loyer sites for Life 
. Skills or Basic Skills ah t>^>tion witl^n your program?' , 

^Yes • No ' / ' , * 

(Not answered at one site) ^ ' ^ 



B-IS 



-J 2, If ' ''special, placements" ar^ ct part of /your 'program,, have any • 

• * ' students begmi tiiem yet? - , . ' ' 

> Yes V 3 , ' No I , ^. '^"'^^ * *^ s. 

fi\rot aiiswered at one ^ite^ . " ^ * . 



) 



I* 
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APPENDIX C 



0 



Tabulated Responses to the , 
EBCE Student Epd-Of-Year Questionnaire 



You are ready, to complete a year of participation /in your Experience-' 
Ba^^ Career Education' (EBQE)' program. This questionnaire ^ks some of 
the. samsr questicms that you m^g have ibeen ^asked in September and adds 
some neuf ones^J±at c6ver your career plans, personal experiences and 
knowledge aiout iSe i^orld of wotk.'^^ If ,yo\x have any que^timp while yoyi 
are completing the survey, please ask for assistance. ' , 



Site Ratings* 
A B C 



TF 



What do you expect to be doing \aie year 
after oompleting hi^ schpol? 



36 44' 59 47 ; 41 
^8 5' 



/ 



' 0 

.7 
-71 
0 

• » 

14 

7 

■ 7 



5 20 



29 
0 

0 

14 



'1. 
2. 



16' 14 20 24 \^4 



0 '14 

6 



7 18 36 



f s7 12 



0 
7 
0 



0 
P 
0 



0 
0 
7 



7. 
8. 
9. 



Working full-time 

Entering em apprenticeship or one- 
the-job .traiJiin^^ program 

Going into regulcir military' service- 
or bo a service academy 

Attending a vocational, technical, 
^tra^ of bvisihess school 

Attending a junior or community 
cq^Llege 

Attenjiing a four-year college or 
university * . ' 

Working part-time 4 

Other (travel, take a break) 

I iiave* n9 idea whut 1*11 be.doing 



,f sites A to D represent pilot sites, TF represents lirst-^year students 
-at the/EBCE demonstration site in Tigard cind TS tepresent's^Bcohd- 
yeeu: JSBCE students at Tigard. * \ - ■ 




1 




. ERJC 



( 4 

V 



Site Ratings'. , . - . 

. _ ^2. How far,. do you plan 'to purjBue your ^ 

, " • '- formal ediication? " „ 

^ 0 8 5 0 8 '1.' Don't plan to* finish high school 

50 ^ 48 * 23 27 er 48 ^ 2. High.sqhool gradviate 

29 28 41 47 ' 41 28 3. High school plus one or two ye^ars.of 

^ , — ^ .college^ camaunijsy college or 

special training f 

7 8 5 0 2'9 — 8 _ 4v High school plus three or more years 
- *s of college, conanunity college or 

special training ^ ' . 

— - » 

14 0 9 20 24 0 .5. Four year college graduate 



0 ' 8 18^ 7 0 8 6. 



Graduate or pro^^sici^ straining ^ 
^beycxid college -H^^ 



. , * . • ^ * . 3. Pleaise list ^o jobsJJiat you feel you i 

might like to hold after coo5>let^g your 

' * -"education. Gi^ the. vocation rather- than 

# — 

location. (For example, say a "draftsman " 

^ - , rather,^than "working at General Motors.") 

^ * ^ Jobs were coded according* to *Holllngshead's 

' ' socioeconomic ^status system into the ' 

^ . ^following categories: - ^ ^ - - 

^14 '"0;^ 5 7' 12 1*4 I 1) Higher executives -and major professional 

36 8* 14 33 35i 36 2) Business ngipagers and lesser 

^ ^ ' professional's / . 

< ' . ^ fi ' ' . ^ 

pL2 33 13 12 f 3) Administrative personnel and minor 

^ professionals 

29 8 5 7 18 24 .1^ 4) Clerical, sales workers 

{7 48 33 20) 18 7 ^^)' Skilled IfnanUal employees 

16 10 7 0 ' 6) Semiskilled employees , 

7% .8 0 13 . '6 7 \ • • 7)Miskilled ' " - , 



Have yqu observed or' directly worked 
art either or both of the two preferred* 
jobs listed *£or qtiestion^ 3? 



56 56 55 -73'' 29 50 ' - 1. Ijjobserved* and woifked at. both jobs 



4? 36 41' 27 65 50 , ^ 2. -^1 cdjseifved or .worked at pne^ .^J^iese 

* * ♦ ^ two jo5s • , •* * * ;^ 

0 ' ' 8 5 0 6^0 '3.. l>-did not observe 6r work at either job 
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Site Ratings '2 

0- * 

A 6' C- D IF TS 



7 


4 


0 


0 


0 


0 


21 


46 


18 


20 


12 


7 


29 


24 


41 


60 


59' 


. 43 


'43 


24 


41- 


20 


29 


50 ' 












•f> ■ 


'79 


64 > 


91 


93 


76 


93 


^' 21 


36 


5 


7 


24 


7 


0 


9 


5 


0 


0 


0 



7 
21 



12 X 
2 



0 
29 



27 20 

« 

57 . 4s' -64 60 71 
36 2 8 32 7 47 
57 72 



S? • 93 82 



3' 

. 7 



20' 36 
4 14 



13 47 
0 6 



57 SO '68 60 65 
' ^6~16 32. 33 29 



7 
50 

10 

43 

93 

43 
7 



71.. 
24 



5. How' siire are ^ou of steps to prepare for 

^ • and enter the" job ^ich you j<auld most . 
like to hold^ after graducution? , 

1. Do not know where to begin 

2. Have some idea. 

3. " Steps'^pxetty clear 

4. Steps quite cle^r 

6. Do you feel'you will be able to complete" 
the necessary steps for this job? . 

1. Yes . ' , ' 

2 . Not sure • • 

3. Probably not 

7. What aspects of your Xeaming escperienqe 
this- year, if-^any, jLnfluenced your choice 

^ of potential careers?^ (ChecJc as many as 
' applg.) 

1. None , ' , ' ' . 

2. I talked to teachelTs^r a comselor 

•,jj3out my choices 

» * , 

3. I talked to people v^o 'work at the 
jobs * , _ 

4. r talked with relatives or friends 
about my choices 

5. I had experience in observing or • 
trying out the jobs 

6^1 read about the jobs ' - 

7. Other (Please j/rite in) ' 

8. Are there any jobs that Isist year seemed . 
interesting that .you ' flow feel do- not 
match' your itntereslis or *abllities? 



2. 



Yes . . 

No ^'^ 



} 
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76 



C-r3 



Site Ratings 



A B . C • D / TF TS 

4 



0 


0 


5 


0 '6 


14- 


1. 


0 




5 


0 12 " 


21 ' 


. 2. 


7 






7 ' 18 




_ - 3' 








¥ 


T 




. 0 


0' 








4. 


64 


16 


'64 


33 65 , 


79 


5. 


7 


^ 4 


32 


27 35 


50 


• . 6. 




0 


' 9 


0 0 




7. 














^ 7 


0 


0 


a- ■ 0 




8. 















What caijsed you to change yoiar mind 
about-iiie job(s)? (Check one or more 
"of'tSe^foliwihgZr " ^ ^ " ' \ 

Advice "frora teachers or a counselor 

Advice frcap relative's or friends . • 

^Advice frgm someone who works at the 
job(sJ ' 

Information I have read alJout the 
jqb(s) ^ , 

Experience in observing or trying 
out the job(s) 



\ ■ 



s 



7;7 



d'4 



- ERIC ; 



On the grid below please circle a number from 1 to 5 to indicate, hoi/ 
help^l you feeVE^E he^^t^en to you in paachM^g each objective. (For~ 
example, if^orXJEeel EBCE was. very helpful circl^e 5, if moderately , 
helpful circle 3 and if little or no help circle 1.) • ' . 

How^hel^f^ljdo YOU feel^youp:^, £BCB^ expejaences ' this yearTia^ T5een in' I 
helping you*— — _ *' 

Site Ratings^ ' > ^ 

A - B e D -TF ' TS I ~ . 

4.57 4.00 4.77 4.Q7 4.35 4.21 ' 9'. solve problems logically 

3.64 3.08 3J82 3.60 3.83 3.93 10. -understand the role" of ' 
, • ^ ^ science in ouol. society 

^ tojflay _ ' 

4.36 3.64 4.82 4.00 4.65 4.50 11. understand more about 

yoxirself « 
4.57 4.28 4.86 4.07 4.35 4.57 12. get alOTg with others 

3.57 3.12 3.90 3.27 '3.59 3.79 13. understand the c^^mocratic 

process " ^ -< 

4.29 3.76 3.36 3.87 4.06 ^ 4.00 14. develop your own creativity 

4.57 4.04 4.82 .4^60 4.59 4.57 15. learn how your interests 

^ ^ and abilities fi^bflnto . ' 

' * ^tential ceireers 

4.21 3.52 4.32 4.00 4.06 4.36 ^ 16. learii how society»s values, 

the government an4 the 
^ econoiyiy affect the worl<f of 

* ' 'w .work- 

4.71 4.12 4.59 j .53 4.29 4.71 17. learn what to look /at in 
• considering a job 

4.36 3.84 4.09 4.20 4.00 [ 4.67 18. learn how to find and keep 



a job * ^ 



4.43 3.92 4.27 4.00 4.29 4.43 19. learn the basic skills . 

• necessary for the careers 

^ that interest you 



♦Figures —listed for each item represent the mean responses ^f or each 
site. ' . ^ ^ . 



Site Ratings V 

A B C D TF- . TS^ ^ \. » 

^r7d —3.-44^— 5-. 73- -3^06- -3ir59 3.07 - 20. ^ i?!5)rove your' reading sJcHls 

3.57- 4.04 3.59 3.20 3.53 3.14 " 2i. in^rove your'math skills- • 

•4.43 3'.25 -'4.50 3.73 4.35 4.43 ''22. in5)rove your^oral 

' \ ^ docnmunicaticai-^ills 

4.14 2.88 4.00 3^.67 3.82 4.14 ^ 23. improve your writing / 
_ > \ ^ ' ^ skills ^ , » 

4\29 3.40 ^ 4.50 ^ 4.27^4.18' 4.07 ' * 24. know what level of basic 

' * ' skills proficiency is 

re<5[uired in the jobs bf ' , 
, ' * interest to you 

4.21 3.52 4.27 3.53 4.29 4.00 25* gain ccxifidence in yaur 

»^ ^ ability to apply basic 

K ' skills to conplete tasks- 

and to solve problems ' 
Y . ' around you ^ ^ 

4.21' 3.56 4.41 3:87 4.18 4.64 26. become acquainted with a 

broad range of resources ^ 
to li^se in gathering *• 
^ . - -information for woric and 
: ^cision making \ ' 

4.21 3.68 4.55 , 4^53 4.24 4.29 ^ 21. communicate ca^fqrtably 

' " with adults \ ^ - 

4.21 3.88 4'.41 4.40^ 4.41 4.07 2(8. take respdnsibliity fo^ 
^ • ' your own actions 

4.3e^3.72 4.-46- 4.07__ 4.53 4.21 ' 29. become more opeif to ideas • 

and valties different from 
your own 

4.29 '3.52 4.32 3.93 Ji-^5 4.36 30. use information obtained- 

^ through dii;ect experiences * 
' in making decisions , 

4.43* 4.08 4.59 4.20^ 4.47 4.71 31. feel prepared to 'accept 

^ adult responsibilities 

^•^^'4.32 '4,.64 4.13 4.53 4.6^ 32*. How would you rate tiie 

'^ifc ' ; ^ , „oyerall quality of your 

- . • * EBCEi^rcjgram? (Rated: on an 

, exceilent to poo^. scale) 

4.24 4.86 . 4.47I 4.65^ 4. 43* 33. If you had it to do over • 

^ again, do y.ou think you , 

" * ^ would 'decide to participate 

^ * * in EBCE? ' (Rated on a • 

. % - deflni tely . yea^s^ d&fini tel y ' 

• . , 79 """T^^^ ' • 




Site Ratings ' . ' % - 

A ' B ' C D TF TS . . ^ 

4-56 'J.96 4.64 4.13' ^.25 4.50 34. • In -EBCE havd' ytDu- felt-that^ _ 

t ^ ' . - you could -progress at your 

ovm rate? (Rated on a 

^ definitely^ yes to d^initely 

^ ^ ho scale) ^ 

5.00 4.i8 4.68 4.73 4.2SI 5.00 ^ 35. In cOT^arison* vith regular 
r- ' ^ higfi school/ how much 

> - opportunity di^ EBGE 

' " ^provide you for learning. 

about occ\5>ations? (Rated 
on a much more to much less 
-se^le) f-r 

4.64 4.28 4.36^ 3.87^- 4.35^^ 4.07 "^36^ In comparison with regular 
I ' ' high school/ how much 

^ ♦ ^ ^ , * opportunity did EBCE 

^ ' ^ provide you for general 

y * learning? .-(Rated^on a much 

^ * * more to much less scale) , 

^4,57 4.04 4,57 4. 00"^^ j. 53 4.7i 37. a;n con5)arison with past ^ 

\ experiences. in fregular 
* ' " -^^ ^ • high school/»*-how motivated 

cire* you to learn in EBCE? - 
(Rated oh a mucH more to • 
, much less scale) 



c 



site- Ratings 
A 'b C D 



14 



TF TS 



*36 


56 


64 


40 


65 


'57/ ■ 


1. 


29 


3? 


9 . 


33 


18' 


0 




21 


8 


27 


20 


12 


36 


3. 


14 


4 


0' 


7 


6 


- 7 

* 


4. 
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7 24 

21 20 

29 *4 

21 20 

14 28 



9 V 0 
14 ^13 



0 
0- 
6 



14 13^18 
55 73 59 



0 5 



9 



21 20 18- 

21 2'8 27 20 ip 
7 

8 18 



24 23 20^18 



29 20 



12 
18 



0 

14 
36 
21 
29 



0- 

.7 
43 

7 . 
21 
21 



-38. ""Wl^t courses, if any, have you taken 

*^ the regular high school, a -community: 
college, employer site or elsewhere? 
(Please list;; any courses and.wii^e 
they were ^^taken.) 

Nqne ^ * * _ 

One :\ ' — 



. ThVee * ' . ^ 

39. ^This year, approximately hov/ many 
' pamphlet6 , brochures^ manuals or 
magazine articles you read? 



40. 



1*^ 'None 

2. 1 to^ 

3. 6 to 10 
11 ta 20 

5. 21 to 30" ' 

6. More than 30 j^ -.. 

This yeeu:, approximately how many 
r books (not counting textbopks) did 
you read? - V ^ 



1. None 

2. 1 or 2 , 

3. 3 to 5 

4. Between^ 6 and 10 

5. Between 11 and 2jQ 

6. More than 20 - 




^Figures, listed in the. remainder of this a^>pendix .represent the percentage 
of students giving that response at each site^ , • . ' ^ 



C-8. 



'31 



mm 



Site Ratings -. - 
a/ Bt C • D TF TS 



i - 2^ 10 f3 6 



7 



36 64 • 29; 



47 21 



36. " 2b 61' ■ SO 47 . > 71 



.'A 



0- 28 14 . 7 -6 . 14 
il 16 27 13 12' • 0 
' 29 24 479^47" ^1" " 

,*'il 23 r3 .■24'~y36 . 

0^21 > 



. ,7 , 22 5 . 7^ 



0 S 18 2 -0. 

0 0 0 0 eft '6. 0 : " 



1. No, or cilniost never ^ 

2. Yes, at 'Ijeast once or twice a.week-^' 
• Jes, almost ^Very day"' ^ ' 

42 . , If you read the newspaper at^ least 
once a*week, what, sections* dp ^^ou^ 
" usually refed? (check onei8xJas many^ 
as ^applicable . ^ I ' 

■ ' , "■ ' ^/ . . 

' : 1. Sport;s* ' * ^ 
- ■ " /■ 
2. Fashions 

'.3.' Pronjt page, newa* 

' ' - % f m i ' * ' 

4. Comics^ ^ 7 . * 

^ ^,5. Editorial ^ ' . - ^'^ 

r 6. News columnists/ such as Art Buchwald 

* . 7^ Other please' list) 



V 



« > 



■ / 



42 4 .14 



^ •.14 



0 12 23. .'7 12. --14. 
^21' 60 14- «3 29/ 21 

14 16t .23 .20 18' 21', 



0'\ 4 32 27 . 2^ 



'8 41' 0 'ir 



7 



^^'^ 43r Dxirincf^'the school yeai;, approximately . 

* ' how many viaits ,did ^ou make to the 
^ • ^followiii^ ;copim\ini^ 

• fChefijc thejfappropriate response for ^ 

. 1 . Public librajfies . . . « 

• ' -3..- Courts • • ' , 
' 4. UMbiic "meetings ' 'n*^ 
, f .5. Local, colleges or unive#§Jtie«s^ 

1' ' 6* ' State Legirslatiixe, ^ . 



- " * ' * 



1 




...» t ■■ 



-9 
i 



■en statements about career pj^^nhing. 
ther the, Agree _pr Disagree' dwitoi. • 



For 'each 



te Ratings 
C 



A - B 

49 ' 36 



Di^agi9e* 51 64 




16 
84" 



Disagree 



35 
.65 



Agree ' . 56 > 
Disagree* "14, 



52 
^ 48 



8B 
12 



Agree 
Disagree* 



?1 ^ 48" 
79 52 



Agfaree 42 
Disagree* ^8 



Agree * 
Dj.Sct^ree 



70^ 

30 . 



32 
68 



52 
8 



41 
59 



23 
77 

K 

45 
55 



.91 



23 
77 



45 
55 




13 
57 

67 
33' 



87 
13 



^13 

'8f 



, 53- 
47 



82 
18 



100 
0 



6 
94 



41 

\59 

9 



76 
24 



18 
82 



41 
59 



94c^ 

\'6 




TS 

42 
'58 



4» 



14 
86 



42 



100 

<3? 



100 



28 
72 



86 
^4 



44. * Most person^ remain 
; in the same jtob • 

^throughout rheir' . 
adult l^ves.i ^ 

45. ^ew women work 
outside of the home 
after marriage'. 

Less than one-third' 
of job openings- 
require a cdli^ge 
degree » 




fost people have the , 
ility**'tb do well in 
any job if they ^et * 
^ ' their^minds' fcai i-t. 

48. There is only one " 
• _ "right ^jpb^' fbr a ^ 

person in terms o6 - 
his/h^r ^ilities. ^ 

49. . oJhe unemployitient^ratie • 
^ \ of 20-year-olds in the 

4abor* market Us ' . 
' lasually less^an th$ 
rate 'for othear adults* 

50 . Th^ State Engplpyment 
Sertvice Offt^9e * \ 

^ provides free" 

. infoipation about job 
'openings ^^^^Job 
>k ' trad|feng programs. 



iQuestions' 44 to 53 were taken from.tl\e Assessment of ptreer .DeVelapment 
te9t developed by Erediger^ ^^^^^i^b^^^* Questions '46, 50 ahd ' 
51 we^re' tonsidered true^b^ the test develoj^S^ while the" remaining 

^ ^^^!^ ^T® ^considftred false . ,A has .fc^een used' t^ deaignate, whethe^r 
^qxic or disagree-is, donside^ed'- correct for each.ite»> 



s . 



Site Ratings * 
C *D 



Agree ^ 



i 



dsagree 23 20 23 13 .29 



Agree 
'^Disagi 



A .- 


•B 


77r 


80 


23 


20 






28 


28 


72 


72 


•42 


^56 


58 


44 



70 
30 

35 



gzee 

Disagree^ 72 72 37 ■ 53 71 65 . 



35 28 
72 



51» Apj^rentices are peiid 
while, they- ^SSum. . : 

52. * The*^English""and math 

skiiXs of fj^shmen 
are about the * same 
from one college to 
another. > 

53. Ten years frem now 
most jobs^ill reqiiire 
foUr or more^^eirs of 
college. 



9- 




/ 



» ^ 



•'•V 



ERJC: 



■Si 



Appendix d • " - ■ 

. Tabu! attclc^di vidua! Student Project Evaluation Form . 
for. a Randoit Sa^le of Students from the Five.EBCE Pilot^Sltes 

Project Evaluation • : - 

1. Are the project activities designed to help the' Student loeet the; 
specific 'dbjectives-if this Life Skills^- area? (Indi-vidualized 
Iprojects only) * • ^ ^ ^ ^ * ' 



Definitely ifo* 

• ' : 1 . 2' 3; 



' Undecided^ • - Definitely Yes 
4 6 7,. 8 9 . - • 



10*- 7 ,13 y 7 2 4—2 



2 11 



Do the project activitfes meaningfully incorporate the Use of Bcisic 
^Skills ill ^ way to promote' growth in. communications, reading ^d/or, 
I mathematics? (Individuzjiized projects only) 



< 

Definitely No 



^Undiacided • ( Definitely (Yes 

4 5' 6 / 7- 8 ' 9 y . 



.9 



7 5 

: ^ 



6 16 



3, 



Is there*a relationship between project -activities and Career 
Development outc^e objectives? (Individualized projects only) 



De^initeiy'No * 

1 a ^ 3 



Undecided 



8" 9 



initel^^is 



26 \6 '. 3. 6 

* p 




4, Wa^ the^ employe r^or copnu^fey .^site usfed productively? (Chede if- 
eniploy^er or^community site is npt used — 123] ), (Individualized ' 
projects- only) , " " . - . 



Definitely No 


, Undeciided 




• 'ft 

■Definitely Yes 




4. 5.^ 6 ' 




-8- 9 . : 


- • . ^^2 1 


0.0 4 




.5- 22, 



Q 



♦Numbers below e^ich nine-point scale represent tKe numbeij of student 
projects re^cei^ng, particular rating i' In cases-Where. inf6tmat:ion 
did not exist flo 'make a reasonable » judgment/, the project ot. product 
w§s. not rated on that^particulai: scale. . » , T . ' • 



Do^the project active tjLes jttilize a yariety of resources in an 
.irrtegrarted and- meaning ftil way? -(Individualized projects only) 



Definitely No Undecided ' Definitely Yes -, 

1 2_. 3' 4 6 . 7' ' 84 9 '.'V 



6 3 ' 7 6_, 



A- 



9 10 7 11 
-«1S 



6'.'? Is the project designed to capitalize on student interests? 





Definitely No 


. Undecided 


Defirfilely Y^s . 




1 ' 2 3 


4 5-6-7 


a' 9. 




0 -V; ^ 0 


' 1 5 y^k^ 





. <7. Are ttie perfonnaiice criteria speci*fied adequately? 



Definitely 'No. 



. Undecided 
4 3 6.' 7 



Definitely Yes 

8 r ' 



l 3 



3 - 13 • 0 12 ^ 22 15 15' 



.^e the actijvities ^propriaJ:e for the student 's^* abilities? 



Definitely No 



Unciecided 



Definit^aly Yef 



1 2 3 4 5' * 6 7 8 9 
5 or 4\ 13 25 51.^ 



0 ^ 1 



,9. Is the project sufficijantly domprehensiv^r amd complete? (Individualize'd 
' projects aily)ar / ^ ^ 



Definitely No 



Und€fcided 



Belfinltely* Yes 



f'':^. ' -**5^ is the quality; of the le^ing manager's written evaluation? 
'y._ . (Check if there were nQ written cqmrnents-- [14] ) - i.. ' 



Ijw/Quali4:y 


Undecided 


, High* Quality 
7 .8' 9 ^ - 


i '' . 








[ 1' 2 3- 


4 5 ^ 






-1 


3 ■ 5 ^1 


7 3^ 


12 14 13 ^ 








\ 






, K , d 









li. To what exjbent arie the project's 'acti^rt.ties -connected in a'Jogical'' 
manners . (Indi-vidualiiied projects only.)'' ' ^ 





No Logic ' 


Undecided' 


'Hrghly Logical 




\: 2 


34' 5 • £■ 


'789 




' 2 2 


0,2 0-4 


" 6- ^ 14 33 ' 



12.. TO|j|/baf extent is the project* experience bc^d (i.e.') invoJ.ving 
' ^ ' V^^pt3dentn±Lrectly xxj the learning process)'? (Individualized 
• projects qhly) ^ / ; ' 



*No E^qperiiance 'Base \ Undecided Highly E^^riantial 

- ' : t • \ ■ ^ • ' , *^ _ 

. / ^ 1 T <* 3 ■ 4- 9 6 '7 8 ^ ; 

• ' . \ 7~jr~2 2 6 '^h 7 4 - '7 32 



4.3. \Dbes the stu^ent^ product h'ave'the technical qiiarlrty* '{e.g. / legibility; ^ 
*i Wrainmaif , etc.)' that you would e3q>frct of a student qf h'is/hjpr abi^ty? 



Definitely No- Undecided Definitely* yes 

. \ 1 .1 ,\ 4 5 . 6^7 ' 8 ^ . 



28 . .s 



for a 'student of hi^/her ahilitij?' 



/14. Does th^ ^student i^roduct^ coimn\aiicat6 'as^ clearly as yj^u would expect 



^ — r*-- . > • ' ' 

Definitely No ; / ^^ilndecided ' Defl^niWl^ 
1.2-3 *"4' 5 V„6 '7^*'8 9\ i 



--4 
Yes 
J 



0 . 2 \ 0' . 6 2 1 14 11. 3^ 



p. 




•J V *v 



•S7 



V 



. . . ^- ' 



15-. *Do'es th6 stAident'pijQduct indicate *th$t' he/she ccmipleted e^h' 



activity? 



Dl^ini 



initely No 

1 '2 3 



: f— 

IWifleci 



flecided Definitely Yes 

^4 5 6: \ f 8 9 "_ ^ 



7 '^14' 22 *18 • 



- •:■ t -n' • '-■ ^ .' * 

16- Hov would you rate this product iti terms of the student's dembn,strated 
ability to integrate his/her experierice? * . ^ 



Definitely Negative 'undecid^ , De finitely^ PpsitiW , 
/ *^ ' 1 2-3 4 ^ 6 .J 8 9 ' / 



>0 ' 1 



2. 5' 25 12 12 



17. Giv^ this student's Ability;, what is^your overall evaluation" of 
' the product? — ^ . . , ; . ' ' 



^ Infinitely Negative 

'1. 2 --3 



Unde bided 
6 



unoecx 



Definitely Positive 

X. 8 9 , ' / , 



< ^17. 11 12 



1: 



• f 



■ 1 u > 



- ERIC \ 




*. i 'V. 



4> 



appendix's 



EBCE' Employer Opinion Surve^ -Summary * 
for Thr^e EBC^. Pi liot* Sites 




Approximate number 'ot employee^ at your site' 
Mean* 11.,^ Median 4",^Range 1 to 87 ' " - "J" 



V 



students in the program visit employer sites ior kn estploraticm -level * 
(usually several 4^ys~~to gret an av^jrview of a particular "job) or for a' 
learning* level (usually several Weeks or more to work on a project or 
• * get- 'a jnore d^n-dQpih view of an occupation)^ • - - . 

When the student is on an exploratibcffT or learning level at your' 
-site* approximately how many hojirs per do' ybu typically spend * 

with the student? * , , ' - ^ * ' 

N^anbter of hours per week for e:^loratxon level: ' \ ^ 



a* / 



Site A 
Site B 
Site Xi 



Mean ' 
» ■ 

. 8.2 

8.7 

6.8 



Median 
, 6.0 

5.4 . 



R3inge 

1- 40 

2- 25/ 
2-20 



b. Ntimber- of hburs per* week for learning 'level: 



Site A 
Site B 
•Site C. 



Mean 

9.1 

15.9 
'15.1 



Median 

6.0. 
, 12.0- 
8.5 



Range 

- r . 2-50 
r ^ 1-70 
2-6(9 



2. Which , of the^following suppor:tive serviced do you (or others at your 
'site) .^TOvidiS^ for^thfe' students? Check each appropriate categoiry for 
expjLoration ifevel and for leeiming level if you have had students . 
for both levels." ^ 



Exploration Lev^l*"^ "XeSrning Xeve! 
A :'. B- C 'I A '^"B^ * C 



' 3?alk abbut job opportunities? 



^1 



fa,'/- 45 . ' 44 '. ■. . 4^ 42 




^*Fi^Vu:esJ*shoKn 'here.aiid in the remainder of this ^^pendg^x r^^fief/to 

percentjiges based on responses from 32,. 41 and 3p^mployer6» at each^ ^ 
, ' . site Wo t all employers •complet^'d each iteiff. - <^ - 



^ERlCf- fey- 



•59 \ . ' ' t 



Explore tic3n Level 



Talk about the )ptuftnt Is' personal ];3 
*pt<obleins? 



Talk' abput activities at yc>iir 
'site? 



iK' about 



84 

13' 
2S 



Tutor in academic ar^a? 

Evaluate individual student * s 
assigfifio^nts? . - ' ' , » 

Assist students in non-job-^ ^9 
irelated assignments? • ^ 

^SVipervise students to perform a^ ^56 
. specific joB-related task at your * 
sitQ? 

Help plan student cissignments? 22 
Other (please write in) " ' 3 



- 6 

■17 
88 

'io 

.51 
12 
44 

■32- 

a 



Leeiming'jtevel' 
A . B *C 



■ 68 ' 
32 



90 
50 

82 

37 

61 
95 



50 

16 
25 

6 

42 

22 . 



32 
51 

I 

22 
46 

22 

56 

44 



53, 
27 

82 
32 

V 

71 
37 

45 

9.5, 



3.. How did .you become involvad-with---yie-p£Gg3eaa^?- 
Check appropriate res^nse(s). 

* 

l\-^,P*rogram personnel contacted me about 'the 
. ' progrant-. , ' . ^ , 

^ ^,2. A student talked -to me about the program. 

3. Another employer teilked to me^abo.ut theC 
• • program. ^ ^ 

4. Company personnel talked, to me about the 
program. > « . 

•5. Other (please mite in) " • 



Site Ratings 



\ 



75 

.3 
■ 3 



78 84 
4 



7 
'2 

12 



0 
5 

8 

3 



'4. Did the program- s^aff. provide you with, enough, 
.^nfortic^tiori' to help you^direct studen.t acJtivlties 
at your site? . ^ * 

l^.Yes • ~ 



\ 91 93^-95 



'Site Ratings 
A * B C 



5, Would you recominend to^a .potential employer * , 

or resource person that he/She aXSo becckoe • , . 

f involved with the program? ^ 

1, YeS' ' ' ^ '97 ^ 8B 100 

-2/ No ' • > - " • - • 3 12 * 

■ • ;■>• ■ ■ . • 

6. -- In general, do you think the EBCE studen^ you haVe woifked with are 

really interested in your site? Circle tihe appropriate number 
from 1 Cdefinitely no) to 5 (definitely yes) 

. , , ..Definitely No'. ^Definitely Yes 





1 




3 •• 


4 - 


5 ■ 




Site A 




.6 


■ 41 ' 


16 


. 34 




Site B 


5 


12 


22 


12 


29 




Site C 




3 


.32 


32 


4 34 





7. In 'general, ^ do you tKiilk the students you have worked with cu:e. 
really interested in the program?" 

f IJe finitely No Definitely Yes 

Site A ■ ' 
•Site B 

Si^te C ^ ^ t^^ 

8. Do yiiu receive adequate feedback about what happens to the'^students 
aft^r they leave your site? Circle a number from 1 (ney^r)jto 5 
(always).. ' ' ^ ^ , - ^ 



1 2 


3 


4 


5 


3 




45 ■ 




3 


19 


25 


J 50 


- • ' , 7 


29 


29 


' 39 



^ever / , Alway 



1 '2 .3,-.. 4 . 5^ 



Site A 37 * 26*-.. . 5 i3 ii 

Site 'B , ' 13 ^ 19 19 19 22 

Site C , .17 '^34 '24 (r ? -5 * 

9. D<^ you receive adequate feedback .abbtit the effectiveness or your 

' ' wQrk with <h§^ students? ' , ^ . 

Never ' , , * . • 'ffi^ays^ \ • 

• • . ^ • ft* • i ■ . 

1 2 3 4 H5 ' ■ 



.L7- 



? ^ 



Site Ratings 
ABC 



• 10* "How have employees at you/ site reacted to 
» participation with the program? • Chepk or^e < 



1. - Positive reaction 
2\ Negative reaction 

3. " Mixed reaction 

4. No reaction • . 

' 5*. ^ot- applicable . 
6 • * Don ' t know 



-44 
0 
25 
1\ 
9 

^ 6 



73 • 53 
2 0 
-20 ' 32 



li! to whslt ways (if any) 'hkve t^he employees at _ 
- ' your site benefited^ Check one or more appropriate' ' 
, • responses. ' > ' ^ ■ 



5 



0 

II 



I'.. TheV haven't benefit^(§. ^ • . ^ ; 

2. Increased their awareness of youth. 

3/ Motivated the, regular 'employees ^ furtfier 

training. * * ^ 

4.'. Reduced their workload. " * 
5". ' Increased interest in their own work. . 

6. 'I doii't know. ^ '. - 

7. ■ Other (please write in) >' - 

12. Do you plan-,t6 continvie. participating A'ith the 
prpgram •nex'E year? * • , „ 



' 41 

■ "3^ 



12 8 
61 ',58 
12 \ 11' 



} : 



1. Yes, 

2. No. 

Why? "CCheck one or more reasons heJLow) \./// ^pf^^ 
1.- 'Program is worthwhile ^ . - ^ ■ 



19 ■ ' '5 - 34 
29 . " 24 ■ 24 /• . 
'16 ^ ,15 V 13 
- 3 5 . 0" ; • 

V 

26^- 20 22^ 




2. I like the people involved 

3. My participation J.S a community service. 
.^^4. It is challenging to .me ^ 

5l I K^ve-had problems; with the'stai^f ^ 

6.^^ I have, had problem^ wiyi^the studeirts 

v."" 7.* ,The program is not^ef fective • 

.8« I don't h^e time ' " * 



8^4 79 

i59 45 
29. 2^ 



, 9.- Other ^ (please, writd in) 

. ■ , ■ -." •■92 

^ERLC ' ^ , ^ 'Z • • 



4^ 
38 

0 
0 

13^ 
9' 



OA 0 

^o;<o^ 

2 > 

0 yii 

12 e 



14 



J 



15. 



ISi* What dc5 you think are the ^greaitest strengths of ": 
the program? (checjc one or more) ^ ' 

-^^o^ alt^native t6 a regular high ♦school 
* program " 

' 2^ Quality of the^»taff^ 

3. Students le^m about 'a variety of careers , - 

_4. Students learn about real, life situations 

5. >^Good way of getting students to leeim 

6. Experience in worki^^ with adults ^ ^ ^' - 
^y^f Other ^^piease wtite in) ^ <^ 

\ . * • ' 

What do yOT think are the greatest weaknesses 
of the program? • (check one or more) / 

1^ Some ^udents can' t Tiandle , the freedc^ ^ ,^ ' - 
,.2y .Probl^s in the organization^ of trie program ^ 

3. -S-feixdents not receiving sufficient tredijing 

4. IiAdequate supervision of students on job sites 
5^. Too much paperwork , ' . ' 
6-. ' Other:, / Maybe too difficult for some sti^ents* 



3t^e 

How many students^ ^iDu}.d yoUr site be able to* 
handle at one time f^r sin exploration 'level? 



^1 . . One students 
^. Two students 



3. Three to five students' 
/ 4^;"^ Six. to eight students - 
^ 5* * More than eight students 



47 


37 


53' 


' 1 

"1 


f- 

■ 10 


,. 11 


81 


^8 


79 - 




76 


87 


53 




32 


66 


h 


61 


3 


2 


' 0 ' 






/ 


28 


* 39 


32 


3 


• 7 


• 3 


9 


20 


8^ 


9 


2 


8 


22 


7 

^ 7 


s 








56 


. -54 


• 61^ 


31 


• 32 


29 


<^3 


. 12 


: '8 


'"P 




p 




0 

* 


: 0 



Site Ratings 



B 



16# ' What dc^ou feel students are able to learn on 
job* sites that they cxjuld not J.eam as we^ll ii> 
' a regular school classroom? (Check one or: more) 

/' 1.^ Firsthand knowledge o£ • d^ands in a real 

" 2. Working '.with other people^ 

* i. On-the-r jo^ "skills 

4. S^f-discipline 

" 5. Motivation tp learn ^ 

6. Nothing* , " 

\. Other (please{^ writ& in) 





83' 


• 








^'^ 78 , 


73 


58 V 


• > 












50 


^ 46 


37, ■ 








'47 


42 


'53' '■ 


- \o 


2 ■ 










3 










• 





















/ 



^4 



ERLC 



E-6 



X 



94 



APPENDIX F " 



•EBuE MateriaU Packet Questionnaire 'Supniaf^ 

4-. ' . ^ ' Student, Career Expiloration - * ' 

^ Your -PCS'! t ion (pheck One}": ^ ' ^ 



12* 1 teacher 
7 2^ - counselor 



29 



3. y adminisjyrator 



'39 4. career /v^catyn^l educaticui director 
14 ^ 5. other; specij^:. 



1. Please rate hpw well the Career Exploration Staff Guide prepared you 
to understand ti>e following areas, \J0ircle a number from 1 to 5 

lir and 1 meanipg yt^Ty poorly.) 

Vez" 



vith 5 meaning ver^ ya^/ i^eanxni 




5 . 4 



F^ir _ Very Poorly 
3 ? 1 



Wh^t the Career Exploration 61 36^ 
5rlycess ^involves ♦ 

- i . ^ # 

b. Rationale for„usxng the 

^areer Exploration process 

c. What is expepted* of staff. ^ 46 
members 

d^. Whatsis expected of studeaits 61 56 

e, 'With what, students the J) A" 59 43 



61 36 



3 
3 



24 



^areer Exploration. process 
'is most appr6priate 

Did tSie packaging-^'f these materials in sets (i<.e, / HWareness/ 
Impfero^ntat^on cind Replacement- Sets) allow you to qbt^^ the . 
quantities of materials appro'ipricute for your purposes? (check one) * 

96 /I. Yes.*^(Only Awareness sfets ye currently available.).' 



*Figiares jeAown un this Appendix represent percentage? of responses 
rbased on an N \)f 28* * 



•3-*. How useful will the ^Student taree^r Exploration, process be to your" 
^ students?"" (circle one number) 



Very Useful " . ^ot Useful 

5* - « 4 - ^ . 3 ; . 2 ' 1 r 
' * ^ '48 37 ~1J~ 74 ] = ^ 

4< How easy will it be (is it) to in^Jlement, the Studenb Career- 
E^Sploration process? Icircle one nuinber) ^ ♦ . 

, • / , ^ * ^ \ _ 

Very, Easy ' ' 7erj^i?]^ficuit . . . - 

19 '37 37 ' * 7 

5. How well will (does) the Student E:^lotaticai process fit in ^ith 
your other instructional activities? (circle one number) 

Very Well ' , , '^^ery Poorly 

''5 ^ 4 3 2 ' q . 

. . 3a 37 ^ .30 4 

6. Have you already modified (or dq.yoxijplan to/ifiodify) the Studeijt 
Guide or the Career Exploration procd§&? (check jone) , ^ 

41 ir.^'Yes / ^ * ' • ' 

56 2 . Wo ' ' _ r 
'4 3. /l 40 not plan to use^ them. 

''''^ , ; ' ' • : ' . • . _ 

7. What best describes your plans tot using the Student Carfeer 
^xplorat^ion process? ' (check one response) 

L8 1. The Student Career Exploration -process is already being losed 
with students by roe or, other staff roe'mbers. * ."^ 

43 1, Plans are underway to us^' the Student Career Exploration 
process dn the near fut;ure. .$ 

27 A decision has not been made yet ofi whether or not the Sttident 

^ Career Explor'ation pigocess will t>e. losed. , ^ 

4 4. I do not plan to use tHe Student Career Exploration ^process 
becaiise * ' ' ^ . . , , 

r4 ' 5. 'other (please specify) ♦ . *. * . 



If the 'student Career ETxploiration process, is presently being use<5 or 
.will 'be u^ed in your school/progranirHplease' describe the gtoyjps of . 
* students with wl>om it is being or will be used*.- (Please fill in "a 
rcw^or each^ clkss^ or group who are or will be using the Career^ - ^ 
Exploration prqpess . Use the bottom of\this sheet if more^pace is 
needed,) » - * 



Nuijibe^c of Students 

11-30 stUden^ - 5, 
stunts - 6 
^I'-ISQ siiudents - 5 
151^400 students - 3 
Not reported - *9 



s 



Grade Level 

7th^ & 8th gtade^ - I 
7^t(^ 12 - 1 * « " 
8 to 10 3 * ' • 
,10 to 12-11 
Not reported - 9 



How Often Used " 

Dai^ly for a year 
Daily for 2-3 

months - I 
Da^Ii/ for 2-3 

weeks - I 
5-20^ time a 
, year - 2 
3-4 times a ^ ^ 
' semester 7 2 
Not reported - 18 



. EBCE Materials Packet Questionnaire Suniiiary 

The 'Con^etencies> 



Yoxir Position- (cfieck one) : \ ' 

12 *1; teacher. ' , ^ ' ^ " 
4 . 2 ; counselor . ^ ^ , * 

25 3. administrator - , ' " ; - 

46 4. career/vocational education director / . \ ^ - ' ■ 

13 5r ^ther; specif^: - \ ^ ^ ' , 

•1. Ple-^e^rate how^ell'the Competencies Staf f Guide prepared you, to 
• * understand the following >creas. (Circle a nuznbeB- from i to 5 with ^ 
' 5 weeing very wjall, 3 ms^^ing fair and 1 maaning very poorly.) 





r f • • Very Well 




"Fcdr ' Very Poorly 








'4 


♦3" 2 1 " 


a.- 


--. - - ■' ■ 1 

.What the. Competencies 


• 83 




■ .4 , - ■ - ) 




involves 








b. 


Rationale for using 1;he 


71 


25 






Competencies 




J 




c. 


Vjhat is expected of staff 


50 


46 1 


4 




members 




1 






Wha€ is expected of 'students 


r 

^ 58 






e* 


With what students the 


44 > 




17 9 




Competencies are most 










appropriate * ^ - 






, . — 



..2. Did ,tjh^. packaging of th^e materials, in' setjs (i.e.^ Awareness, 
Iit^l^ntation and Replafcemeht Sets) allow you to obtain^ the 
quantities of materials appropriate for yo^r purposes? (check one) 

100 1. Yes (Only Ayareness sets are currently dvailahle.^)^ '» 

, a 2. No • ^ • . . 

« 

3. How.' useful will ^the Con?)eteit<2ies be to your stuc^ts? (circle 
*- . • ' ^ ' 

^ ► one number) - . » . r 

V&ry Useful - i^ot Useful 

5 4^ 3 ^2 1^ 

52 30 • 27 ^ ■ ^ ' - ^ • . 



^Figures shown in 'this appendix represent percentages. of responses based 
on an N of 24* ^ ■ > ^ ' • * . ^ 



.4. Haw easy will it. "be (is it) to implemeivt the Competencies? 



(circle one number) 



Vfe^-y Easy 

^ 5 



1.7 ' 



± 



^Very Difficult 
"l'^ 1 



4a 



22 



IT 



1 



5. How well will (do) - ' the Competencies ^it in with your other 
instructional activities? {cixcl^ one nvmbet) 



V 



Very t^eil 

^5 4 



2 . 1 ' 



Guide 



30 



55 



30 



6^* Have you already modified (or do you ^)lan to modify) the Student 



Dr the use of the Competencies? (cheek one) * 



32 ' l\ ^ Y^s 



41 
27 



2. Nil 

3. I 



7. What* be 



do not pla^ to. use them- ' 

st describes your plans for using the Coii5)etencies? (check 



8 

54 
21 



one resDonse^ ' ' * . 

1. Th i Competencies are already being "'used with students by ma or 
otier staff members* . * , 

2. Plms.are ,unde;£:way to use the Competenqies in, the .naar future.. 



3. A 



iecisicM) has* not been made yet on whether or not the 



Coipetfenci^s will 'be lisecl. 



-17 4. ' 3? do not plan to use the Compa^iencies because 



5. 0th 



sr fpiease specify ' 



^1 



If the/ Competencies are t)resently ^eing xise^.or will be used in your 
;.sch^Ql/prograin, please describe the groups of student^ with whom* they are • 
being or will be used."' (Please^ fill in a row for each class or/ 
group who is or will be using the Competencies . C7se tt^bottom of 
this sheet if more space is needed.) 

■ * f ' ' 

Number of^ Students ^ - Gx:ade Level \ How Often Used 

11-30 students - 4 Bth & Sth^grade Daily ior a ^- 

31-60 students - 2 ' 9th & 10th - 4 . * , year - 3^ 

* 61-156 students - 5 Uth & hth - 8 , Daily for 2-3 

151-^00 students^- 2 Not reported - months - 1 

Not reported -12 ' - ' Daily for one _ 

' % . . //* ^ month - 2 

' , . , ' ^ 5-20 times a ^ 

^ . ^ • • ' year - 1 

. ' ^ * ' * ^ . Not reported - 18 



-J 



) 



.: . ■ 100' 



F-6 



ERIC . • 

^ ■ ■ 
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* \ ^ E6CE Materials Packet Questionnaire Sumnj^ry , 

^ - student Career Jour nal ^ ^ * . 

^ ^ ^ \ 

Your* Position (check one) : • * i . * * 

12\*1. teacher 4 ^ ' , 

8 2 . ' counselor / ^ 

13 3. administrator' * . ~ ^ 

42 4., ccureer /vocational education director 

15 5. other; specify: * ^ 

1* Please rate how well^^^ie 'Career Journal, Staff Guide prepared you tof^ 
vmderstand the following areas. (Circle a number from 1 to, 5 with 
'5 weaning very well, 3^ meaning fair and 1 meaning very poorly.) 

Very Poorly " 
2' -1 . ' 



-f ^ Very'-P/eii 






* 5 


4 ' 


3 


a. What lihe 'Career Joiirnai' 
process involves / 




5y 




b. Rationale for using the "^^ 
Career .Journal p^cess ^ 


62 ' 


■' 21 


7 


c. What is expected of staff 
_X members *• ' * ' 


58 




4 


d/ What is expected of stvrdenta 


58 


42 




e» With what students the, 
, , ^^^r orournai^p^^ccss is 
most apf'propriate 


35 


X6 ,19. 



. 2. Did the packaging of these materials in sets (i.e,, Awarenass, 
^im>lementation ar^ Replacement Sets) allow you to obtain -tH^ 
quantities of materials appropriate for ''your purposes? (check ortej 

96 1. Yes (Only 'Awareness sets are currently available.) • 
4 2. .No ' - ' ' ^. - . 

-3. Hew useful will the Student Career Journal process be to yoiil: 
students? .(circle pne number) " ' 

; , ' ^ ^ Very Vseful . , Mot -Useful ' ' ^ 

-/ " ' ^ * 5 4' "'3 2 



• . . 23. 54 15 . .4 

^Figur^fi sho^m^n this appendix represent percentages of responses based , 
on an N*of/2r • ' • ^ 




■r . 



.1 



• 4.*/ How easy. will it be (is it) to implement the Student bai^^ Joui^rial 
* process? jfcJircie one nimb^r) ' 

• " . V* . Vert/ Easy' * - . Very Difficult 

5 4 3 • 2 : ' 1 ' 



24 32 28 ' 12 - A ' ^ .* • * , 

5. Hbw well will (does) the Student ^areer Jo\imal -process fit in with " 
y. ' your oth^r 'instructional activities? (clrcl^, one number) 

Very Well ^ - Very Poorly 

5 4 ' '3 2 1 . ' , 

39 35 15 8 . i . ^ 

6. Have you already modified (or do you plaiv to modify) the Student 
: ~ Guide or .the Ccireer Journal process? (ctiaclC bne) 

.59- 2 . No ^ . ' . 

14 3V. ^ do not plan to use them ' <^ , - 

'7. What best describes yoiir plans for using the Student Career Journal 
process? ^ * f ■ . 

25 1. The Student Career Journal process is alreiky b^i^g used witft ' — 
stxadent^. by me or other staff members , .7 — ^^--^ 

"42"' 2 .\ Plains are-^ underway to' use J;he Student C^eer J<5umar process 
Tn the near future • ^ • ' 

2^ 3. Ji decision^has not . been made yet on "whether or not the Student 
' Career Journal process will be uped. 

4 .4, I do not plan to use the* Student Career Journal process because 



12 5. Other (please specify) 

V 

t 



If the Student Ccireer Journal process is presently b^eing used or 
will 'be used in Vour; school/pfograirt/ please describe "the gr'oiqps of 
stjudents with whom it'is being or will iDe us ed, (Pl aa^e fill' in^a 
row for each class ,or ^g-foup ifho %re or will be usi^ g ^ ft he Career 
Journal process.^ JJse the bottom of this^ sheet If more space' is 
^needed.) < ' * ^ . • 



Nutnber of Stiidents 

11^30 students - 
31-^60 students - 
61-150 students - 6 
150-400 students - 2 
Not reported - 11 



jOrade Level 



Hew. Often Used* 



7hh-9th grade —-5 , Daily fo*^ a r 
10 th grade 3 ' year - I 

nth & 12th - 7^ Daily for 2-3 ' 

College ^£x^shinen - 1\ months - 3 , 
Not *reportejJ - 11 ^ . Daily for one 

' ► week - •! 

. ^ ^ ^ . Weekly - 2 

3-4 tibes a 
semester - 4 

If 

2 times k 
. semester - I 
^ot reported - 



e 
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^ • ' '• . " ,^ 

INTRODUCTION . ' ' 



f 



This report presents a^aummatV^of evaluation data analyze4 by the 
evaluation' unit bf th*e^ Careei^ Education Progra^a (CEP) at the 
Northwest Regional Educational Laboratory fliWfeEL) .for'*'(CE) Tigard. 
This -program has complete<^ its fourth ^year as- a NWREL ^demonstration 
site of the Eaiperience-Ba^ed Career Education (EBCE) program. . Tfie . 
evaluation - for the 1975-76 school year has been ^conducted by the' 
evaluation unit of CEP.' NWREli staff Have proposed- an evaluation 
design, developed some .evaluation instruments; 'aiflministered^ 
collected and^cpded most ot the data; interviewed staff ^d 
analyzed the -data. Since the NV?REL^?taff have, not conducted ' • 
systematic cJbservations of (CE)^ - TiJfard or been onr-sit6 frequently 
during the year, this present report will suEtnnarize the evalviatio;i 
data that have been, analyzed, but intetp^^^tion of these findirt^s 
anc^^y recomtrvendaticns ^for program taodi£^.cation should more 
appropriate JLy come. from_the project staff. 



is report contains the „ evaluation tiQdihgs of program otitcomes, 
description of each of the following instruments and^ related 
findings i*s presented: the Compr^ehensive' Test of "Basic Skills • 
(tTBS) t Self-Directed Search , Student Opinion Survey-, Student 
End-of-Year Questiqnnaire .ancj Staff Interviev?S. < , ' 



J ^ ' I - EVALUATION FINDING? 

Staff Interviews ' . r ' 

An inte^ien form was developed espe*cially for use with the (CE) - 
Tigafd project staff. Intervi^s'were conduct,§d about -two weeks 
after the end of* the school year wit^^^ach of the (CET) prof^sional" 
st^ff with the tsxception of the prtJ^ect director, whd was out, ot 
town* 'Hie primary intei>t^of the- interviWwcis to assess the 
perceptions of the ^CE)^ staff regarding their role in EBCE , ' 
training amd demonstration activitie's, 

'Two of the questionfe. covered during the in"t^rview werfei presented ^ 
in Written form. since they involved* *a: rating scale. A tabulation 
of »taff responses to' these two items apptears'^r^ Appendia^ A.^The 
type of trstining and demonstration activities' most i^e^uently* * 
engaged in during the year by^CCE)^ staff involved discussions Df 
(CS)^ operations (em average of 12 hourg per 'St^ff member)* and 
(Jtiestion emd em^e;:^ sessicxis. (em average o'f 7 hpurs per staff).' 
Each area of involvement was rated by the (CE)^ staff as ^itfii^ 
high or moderate in perceived e-ffectiveness . 
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Of t^e five (CT)^. staff intexvrewed, threes f^lt their involvement' 

in the! EBCE .tlrainiag' and demons tratic^ act^vi^eg this year contributed 

in a n)lnor way to their ^re'gular v^flc ^ai)^ two^'felt 'that such activities 

neither contributed" to nor interfered. wi^/*tl^ir regular work. ^ None 

of . the staff interviewed' felt t^^t. .their .participation in EBCE training 

and demonstration activities interfered with^t^feir regular work. Those 

wjio expressed th^ view that' sftqFi' GarHcipsLt£on,^,x:ontVibute to their 

regular work stated that it.g^ve''"OifemVin*igix}r^'i^ how EBQE nii^ht * • 

work in other ' setting and caused, them' t^feel they were making a 

professional ' contributi6n.r -The^ third person added th§t it helped the 

students to be observed by visitors and to feel that what, they were 

doing was of >mp|da:tancejand interest to people ^rorh Jiiah^ parts o'f 

the country\ • . " \ * " 

- • ^ ' -I' 

Each of the, five staff members said th'at they'woul^ be^ interested 'in 
participating in EBCE training and demonst^ration activities next t 
year> They felt they, could share their E^CE experiences with others # 
aifswer/que^'tions and describe things tHey' have done to improve or ' 
streamline EBCEj Seve,ral staff added that'tfiey would be'wilii^ig to • 
have a trainee fallow* tifem around/ for excinple, when *they went to 
visit an employer si-te. The' staff indicated that they, indivii^ually / 
shoul'd be a^lowecf^o decide, how iftuch time they couldf commit at any 
given time to EBCE draining and demonstration since they bestrknow 
their own' work 'loads'. , Oie staff membei; also indicated E^st e^erience 
in writing TV scripts and a wiMd'ngness to apply this akxll tb EBCE. 
Several indicated a ^llin^ess> on occasion, to* visit riew EBCjS 
^tes £6 sej|j7e as consultants regarding inplein^ntation/problems. . 
The^ suggestion o^ *involv?.ng staff from, (CE)^ and those! from adoption 
sites in a training retreat vas proposed ijy one staff i^mber. The 
advemtcige of this strategy would be to create a relaixed^atfnosphere " 
in which role ^lay and other techniques could be used to communicate 
the EBCE*experi6nces. ' . ^ \^ . • 

bci^ staff ^rson*etxpreased ajdesire to find out whkt the essential 
differences, are among tlje fotxB^EBCE version's.. For example, how do 
^their delivery .systems differ? Such information would> have been 
helpful in responding to some visitora* questions. • ' 

• ' . * • ' ' : . ■ 

The (CE)^ staff members Were also asked to cptnment/on the perceived 
strengths aind weaknei^ses of (CE)^- Areas* in which students were 
seen to have made the greates.t growth were self-esteem, individual . 
respo'nsibility , learning how to learn, ability to communicate with' 
adults,' oral ^d Writteh communication, ba^ic skills;' willingness 
t,o try new. things, coping skills, handling dissatisf actions * cind 
failures cihd improved communications with parents* Areas in which" ^ 
students were seen ^y three, of the straff to have made only moderate ^ 
' grSwth this year^ were awareness of non^raditional careers, 
knowledge about the job market and career decision-making sjcills. . ' 



In*con5)aring the^ schodl year witf^e priori yeafT'C/ZE) 

st^f f saW the progUR becordng. "oioxe s^al^le*, having" ^ greater ' • 
proportion of self-xiLregted -students, 'ittiplemejciting the Stucjent • 
accpuntabiJi^y^.syBteirtcraor^ -e^fectiyel:/-and*^c^^^ the^ ' 

student .tutoxring system i5etter; Problem aiTeas cited "this , ye air. by 
some, 3taf*f> included the lack.^of staff "^cohesion/ 'less feeding, of 
a** student '6Dminunity and^lesfe progr^s''than desired-'in inte;^atlng ,^ 
ba.s.SrC/ skills' at the employer* si tei. ' » * .'• . ' 



Student Des crip ti Off ^ . ' 



Sijfty^two* students began, the pra^ram year.. Of- these students,, 
wj^re. seniors .wt^jar had attended (CE)- th^ previoua y^ar as- juniors. 
iSfie^e second-yeaf {SY) students' consisted of 14 females and 9 male's. 
• The .remaining -39 students' were students entering the (CE^' program 
fox the first^time. 'piesp 'first-year (FY) students consiitQ(J of ' 
27 females an^, 12 males'vith* 13 seniors, 25 j juhiJjprs "ai^d 1 sophomore^j^ . 

Since there may be differential >f ^FY, an4 SY/-^ 

sdbudenti^, each grot^ of students- hafe^been analyzed separately*^ By 
mid?e^^r^* eight students had left the program.^ Of these students, 
only th^ee vbre from, the SY ^groupY-one move d^ from the area^t-gne - 
voluntarily wit-hdr^w from hi^h^^qhopl and pn« Voluntarily rettarned . 
t6""'the -high'sdiobir ^The,^ students dropped put of " 

the FY Jgrout>--two .studlnVs-:Wli^ from high school; 

one 'Student ran away , one student move^ from the 'di strict:,^ and one ^. . ; 
student voluntarily r.etui^ned to the^high schpot.' Sevjsn new^stude^t^ . ' - 
entered the program "at ^midyearv - ^ / • / ' '.- ^ 

During the remeiinder ^of the school yelar 15 additional-^ students / 

dropped aut of l^e ©rograra. / Two of these students wefe from the 
•SY group—one r^' away and another voliuitarily withdrew from scjtiool. 

Of: the 13 new students whoj^rpppied out "dtiring the second sentester/ 
""ei^ht yoluntayily withd^wNfrom^ school, 'o;ie student volimtariiy 'returfied' 

to^ th^^'high ^c^ScSl, pne student ran^way aiid one ^tudeht^subsequently 
»withdfewtfrom,;hi4h school after being dropped 'from, the progr.am for; ^ - 

nortprogram performance Three of .these students who *dropped*out during^. 

the -second semester had^entere<J at midyear* . ^ ' ' 

At the end of.'tl;je year there weiije 52 •students in the prograa/'of . 
which 34 were new students* Of/'the.FY group, 26^had cornpleWfd the 
entire year and two we^e graduating ea^ly; Of the 18 students' in- 
'the SY ^roupv four were- gfo^duating^early 1 Complete;, data were 
available on 17 stJtaj^'ts, Jfrom. the FY group^ an'd^ lOijaderits fi;om the ' , 
SY grot^. .Subsequem^aAalyses in this report, are baseS' only on 
*those studer\^ for whom^ conplete'^'data iJ^^lfe' available\ ' ' • - 
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The 17 FY students consisted of 5 males and 12 females. Six of ,^ • 

these students were senid'rs vith the other 11 jbeXng ^miors. These 
students cxjmpleted an average of 8.12 career explorations and 2,24 
> learning levels with no students completing any skill building ^ ^ 

levels. '.They also^avdfaged 8.65 projects ancj ^.82 comgetencies ^ ♦ 

each and had an Average Sf 15c.35\days absent from *t^e ,.program^ 

students confeist^d of 5 males and 9 females. All, of 
comtge , w.ere seniors.- These students completed an average of 6.43 ^ 
e^^PKrations >and c2^.9 leapiing levels.' .They also averaged 10.64 

• projects and sS^S. competencies ahd had an average of 16^36 days 
absent from the\?r93ram., Notice that 'these returning seni6rs 
completed signifiN^tly feWer^ competencies than the new students ^ » 
<Fte9.30, df=^ an4 3^, p*<.Ol) . However, -secondrVear students only 
had to qpmplete thos^ competencies which iJiey had not done ^ 

-previously^. However \fQur" jre turning ' seni-ors did complete a skill 
building^ level as comjAred to no FY students. .First-year students 
also* completed. signifida^ieiy more projects th^ SY stifden-ts 

(F=4.50\ df=l and 29, p<..05) . There' were no significant " •' * ' 
! differences, on number of .career explo^ra^ions or days absent. ^ % ^ 

First-year' students in HCE) -completed* a S|:udent Applicat^oa for^ _ . . ^ ^ ^ 
(contain,*ed-^in Appendix B) . Second-x^ar students had completed ^ - ' » 
this quistio^maire the' previous .year upon program Application,* blit 

• their resppnses are considered too remote and will not be . 
considered here. .Based. on responses^ of the FY studlifts in' (CE)^ 

^ for the entire year, 77 percent had been involved in work 
experience for pay , on a tegular basds prior to entering CCE)^- All 
of .these ^students'^'Kad held' lanski lied jobs and wprked to earn money - 
/^pr things they wanted to buy or for work experience. At the, * 
beginniiig of the school year only 18 percent of f the students _ 
indicated that one year after completing high school they expected ' ^ 
to be working full-time, while 33 percent expected to be working 
part-time; ' Oyer three-fourths of the students expected to enter, 
a'school for postsecondary education 'the year ^ after completing 
high school. All of the students, planned ,to complete high school 
^l^^r' ^and 71 percent planned eventually to get additional educa^on, • * - • 

although only 7. percent intended to ^n^lete four years of college. * v 

or more.* ^ ^ , ^y^""""^ . , ^ • 



qver half of the students had not parti cipa|:ed in high sdhool ' - 
extracurricular activities ^the year prior to entering EBCR, while \r 
^ the rest engaged in from one ta -four such activities^ The most 
f!r:equen%ly cited ireasons for, joining (CE) -were to learn about 
careers, prepare for a job and choose one'^s own leaoming style, ^ 
Over one-half of t^e students -indicated that being, bored with ^ 
regular school also influenced them to join (CE)^' \ 
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Growth Data 



,The"MULTIVftRIANCE -^program was useji to^. analyze ^^roVth data. 

Growth data abllected ^t Tigard consisted of scores for t^e reading 
comprehension^ arithmetic cpncepts' ai>d# arithmetic applications 
subtests of "the Comprehensive Test of Basi^ Skills (CTBSj , the t 
Se,lf-Directed Search , the Student ppiriion Survey and* changes In 
occv^ational and educational aspirations, Pre.test and posttest 
^ means and' standard deviations <S»Ef. ) for^the^CTBS are given- for FY 
';^and SY students in Tables 1 and 2 respectively,,. Data are reported 
"eis .expanded standard scores and as grade equivalents tG.E.). 



^ TABLE 1 / ^" 

-ftreTe^f .and [?!)sttest Scores on the CTBS iFor 
Fi>5^t- Year Tigard (CE)p Students r 

(N^17) ^ j , 



\ Pratest " ^ « Posttest 



CTBS: Sttbtest / ' ' Mean' StD.*G'.E/ Mean S.D. G.E. 



Beading Comprehension ^ ,599. 41 87.51 10.0,644*53 94.03 11.8 

Arithmetic Concegts ' 611.71 83.13 10.5^^20.24 80.84 10.9 

Arttliroetic ^plications 601. 4£ 88.98 10. i 613.24-96.04 10,5 



1 : » • 

The pretest scores were used- as independent" variables in a^ne- 

factor analysis of oovajriaAce' of the posttest scores for each 

♦vdnstcuinent . ^ Univariate. F tests "of the growth effects on each 

variab/Le were used for mosti varieibles since the snfall number'^ of 

siobjects limited the multivcCj|^te analysis^ Firp,, J. MULTWARIANCE : 

A generalized tmivariate and^tmtltivariate analysis of variance/ • 

covariance^ and regressions \ Version V.^ Chi'cago: National 

Educational^ Resources, Inc., March 1972. . . " 
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. TABLE 2 ■ 



Pretest dhcKPosttpst S;cores on th§ blBS for • 
•Second-Vgar 'tigar'd (CE)p Students -v' 



• .» ^ V* ' v. 



t 



CTBS ^Subtest 



" VTetest ^ , Posttest 
Mean' S,T). tj.E. .Meen S,D, G.E.- 



■< 



■RiBading Coji^rehensioa ;6Sa!i4'« .8^1^93— 12. 6r-673.'36 i02.96, 13.5 

Arithmetic Concepts M * 6!)9s00 126/^3 10,4 619-36 ^35. 09 10.^5 
Arithinetic Appii^j^i^foi^^;; '579,21 ^9^^4. 9.4 5B7V29 109.88 9.6* 



"None of ;the gains .were significant Although students gained more* » 
' , thr^ one month's grade '^<M3l vale nt on qrea^ing comprehension for e^h " 
montihin the (CE) ^ progrfin'.. This gain also-'^ls reflected by 
students ^reporting at jbhe beginhing^pf <the year*' that ;ione_of them^ 
\had read more than ^30 pamphlet^, brodiuresi* manuals of magazine 
■•a2;t£cles whi^Xe at tJie end^^^f th§ year 59- percent, reported doing at 
least this -much reading ♦ %iere :wefe no sign^icant differences 
} ^iet$/e^ri'^^Fy 'i^d SYt^tUdents~\;on 'basic skili^ .^ ^ v "^.r / '^^i^f ' 

\' The : Self-*.Directed , Search/ developed b;^ John Holland^ was used to * 
identify "occupational 'personality" 'chclracteristics of each student.. 

^ These" six areas'^are: . realis±ic (e.g., skilled trades', technical 
and. some sfeirvice occupations); iaves*tigative (e.g./ scientific and 

^ 'sQpe ^technical occup^ions) artistic; spcial C^*g»/ educational 
arid social y^elfare occupations) ; enterp;:ising'"(e,.g. / in^nagexial ^ 
and sales occupations) ; ,and convpntfiohcil ^ (e.'^g^/ office and clerical 
occut>ations)^; \ - . . / e ' 

It i^ also possible, to^-'cal'culate^ six other scores' f:pom»this' 
instrument: self-^estimates , a^:^^itie*^, ; competencies, occupations, 
^ ' differentiation* and con^ifetency* The seif-e^titnates score 

represents the student's total self rating ^core (on a s.even-pbint 
scale) across 12^trait5 such as.ni^ch^ivCcal SQ^ilit^ artistic \ 
:^ability and-^ffice ^iULs^ 'Two o^thesip traijis*- reflect,., each o^^the ^ 
'six ^occupational ciktegQri^s Styodeifts ''rate -themselves 3ii coniparison^ 
^ with other peirsonsi-^f.jthe same a^ge. Th^ activities score represents 
' /,the student's total number pf ac^i^xiti^s across the six pccupatiohal^ 
- categories 'that th^ student suys he or jhe likes to do. ' Thef v 
Competencies score represents the total number pf '^^ctiyities-across_ 
the six^occupational categories that th^ -student fe^els he or she 
I, can^ do well or Competen^^ly: * The occupations score'^^represeilt 
^ .total number of occ'upatiions that^^e interest or' appeal to* the 
* atudent . Th^ diliqr^ntiatiou' '^o;ce,-;;de^^ jtj>el4AgS§^-tAJ^^ 
ja j^rson jTepresents 'a "pure" personality typeT^- A person^ with vejy ; 
strong "Social" T.nterests and competj^ixpies, for* example, ' i''s' more^^^ 
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of a **pure'*'"typ^ th^ a person .with moderate "Sopial," "Enterprising')'' ^ 
and '^Conventional" interests dnd competencies. The differentiation ; 
score is computed by sulrtracting.^the numerical weight .of the tertiary 
code frgm^^the weight of the primary code. The consistency score is 
an index of the, internal consistency of the personality. Operationally/ 
^it desci^ibes the" degree of . compatibility between_the primary and 
secpnda^ .Icodfe. . For^example, a person with an '^^Artistic" primeiry 
code ^d .a- '^Conventional" secondary code will probably eschibit ' • 
.contradictory behavior patterns and interests and^'receive a Ipw 
consistency score. > ^ix ^ *^ ' 

Pretest and ^sttest means and .standard deviations {SiD^ Wfdr^' * 
subscQxes on the Self^-Directed Sealrch^ alre shown » fot FY ajid 'SY 
students in Tables 3 and 4j-_ ..respectively. 



. ' TABLE 3 ' ' ' ' . 

Pretest and Posttest Scores on the Self -Directed Search for 
First-Y^ar Tijar^ (CEL\?tudents ; / 



Occupatloneil AreA 



rPretesp i 
liean S.D. 



• Posttest- 
Mean S»D. 



itlve 



Rearlistic 
Invest iga 
Artistic 
Sociail 



Enterprising 
Conventional 



6.82 
6.24 
8.12 

ll'^3 
6.00 

.6'. 00 



4-.69 
2.70 
• 3:22 
2i62 
^2.42 
' 3.57 



• 5.88 
'5.29 
6.76 

10.24 
5 .'29 
4.41 



4.91 
2.82 
4.09 

3.^^42 
2;l4 
4.33 



SDS Summary Scores * ^ ■^ 

•S^ If -Estimated 
Activities 
Compepencies 
-Occupations 
Differentiation Socife 
Consist|gicyi Score 



25.53 
31.76 
28.82 
18.35 

* ^6 



^.07 
15^.81 
12.90 
•10.94 

"^,35 
' %83 



24.88 
• 36. B8 
i33.00/ 
20.12 
'6.24- 
2.29 



5.16 
1^.05 
10.66 

14; 10 

2.41 



TABLE 4 



Pretest and Posttest Scores ^on the Self- Directed Search for. 
* Second-Year Tigard CCE)2 Students^ 



Pretest 



Posttest 



Occupational Area 

* Realistic * 
Investigative 
V "Artistic ' . 

Social ^ , '^i, 

_ Ente^iprising , ' " 
^ Conventionail 

SDS Suimary Scores 

Self -Estimates ' ' 

Act;ivduties 
I ^ Coppetencies " T \ 
^ ' Occupations 

Differentiation Score 

Consistency Soorfe 



Mean 




Mean 








* 




5^.86 


, 4i43 


5.. 00^ 


4.17 


6.50 


3.a8. • 


■ 6.29' 


4.07 


7.36 ' 


^ 3.13 


•6.71 


4.05 


10.50 


2,98^ . " 


ID. 29 


^ 3.15 


5.36 


5,92/ 




3.G-7 


, 4.26 


• 2.27 


5.79 


4.69 


24.43 


6V0I 


24.50 


5.21 


33'. 29 


. '11-47 


34.07 


12.45 " 


• 25.43 i 


12.97 


/^.36.. 


^11.36] 


• 14.2>^ 


6.96 • 


' 14.36 


. ^.38" 


4.71 . 


^ 2.67 


■ 5.71 


* 3.77 




.65 , 


2:50 


.65 











Significant differences in pre and posttest iscores were not expected 
for the six occupational ar€^^, since -these factors usually remain, 
stable auid*an increase in inteiq^st ih one occupational area often 
leads fto a decrease in anbtHer. ,None ^of thesya dif fe]pence^ were. 
s;ignificrant' although declines in^t]:^e ^oci^i* (F=2.29, df=l an<^^0, 
* ><.L7)^ scale , for SY students and J^e inyestigative ;Ct'=2 .60 , ,df=l and. 13, 
H<fl4X scale for -FY students ajpproach^d significance. In addition, 
the difference between RY^^^nd SY ^students on the Conventional 
scale approaci>ed significance fF=3.86, *df=l and 6/ p<.07) . 

The total self-estimates, activities /'competencies and^occilpatioasv^ 
scores were anticipated to increase .over the year as stxTdents'. '* 
gained a variety of work experiences and' perhaps came €p view Z ^ 

^themselves in a more' positive light. -All P ratios were^minim^l 
<<2) for the SY students whil^ the self-estimate decrease approached 
significance for the FY studexi;ts (F=3.44, df=l and 11, p<.'09r. The _ 
only difference. between FY, and SY students that approached significance 
was on ocdupations (F=^.ll, S£i=^l/ and 24, p<.10). ^ \ 
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^Increas^s in differentiation and consistency were hypothesized as 
a resul^t of students observing and trying out a variety of job$' 
and learning to discriminate more in what activities they like and 
dislike* Although the differentiaticM scores did increase ^ the . 
difference -was not significant. There was little chcChge on • 

.consistency scores and no significant differences betweerj FY- and 
students- ^/ ^ - ^ ' . ^ 

The^ Studeht Opinion Scale is a local name applied to the 
Psychosocial Maturity Scale developed by Ellen Gr^ianberger * l^he 
instrument is used to assess growth inr nine different areas, many , 
of which *are related to the EBCE Life Skills goals. The results - 
from this instnament are, presented in Tables 5 aind 6 for the FY 
and SY groups^ respectively, ~ ^ . , ' . * * 



, ^ TABLE 5 , 

/Pretest arid Posttest JcoreS?.on the St.u^lent Opinion Scate for' 
First- Yfear Tigard (CE)^ Students . . 

V, i ' ' Pretest / Posttest 

Individual Subscal^s Mean S.D. Mean S.D^, 



Self TReliance ^ 31.00 ' ' *6,03 , 32.47 6*19 

Wo;:k - " . ' 26*24 5(68 28.59 5.14- 

Identity , | ^ . ' ^/ / 27.65 5.^3 29.94. \ 6/66 

Cdninunicat-xohs ^ ) ~ ' -27.59 ,-5.85 29.18 ^ ' 6.55 

Roles f * 31.24 4.85 32.41* "4.95 

Trust ' ' \/ '^^ ' ^ *28.29 ^ 3.51 -29.88 3.89 

Sodtal ComiAitment;" * ' ' - ' 33.00 5.00 34.59 • '4.62- 

Charige ' 34.06 * 5.88 ^6.00 / 3.6.7 

Tolerance * '36.24 5.-54 ' "37.76 '3.70 

Social Desirability 22.35 3.14 21.29* 4.13 



Summarg Scales , " ^ 



Individual Adequapy v • • 84.88 13.07 91.00 , Vl-43 

Interpersonal Gommunicat\ons 87.12r 11.38 91.^47 C _J[l.23 

Social Adequacy * ( , 103.29 14.49 108.35 8.63 



It' 



' • ■ • ' - TABLf 6 • * 

• . ■ ■ -'v . • ' • ■ ' : ■ 

Pretest^nd PosttesTScores on the Student Opinion Sc|le for 
% Second-Year Tigard (CE)^ Students ^ ' 



Pretest 



Pos€tQst 



Individual Siil^kcales . 


'Mean 


3.L 


K 


Mean 


S.D, ' 




Self Reliance ^ ^ 


• ^ 31. oa 


5. 


5.3 


34 loo 


4.74 






25. 57' 


B. 


94 ^ 


^ 29.07- ' 






Identity _ ♦ 


" 26-57 


7. 


61 


«3l.50' 


6.68 




Communications 


. 25,50 


5. 


63 


29.36 


■ 6.23 




Roles _ 


34.36 ' 


3. 


27 • 


' '-35.14 


2.91 ' : 




Tr]i&t . ' ' ^ 


30.64 


3. 


69 


30.86 


3.76 




Social Conmitment 


35.43 


4. 


08 


33.86 


5.14- 




phange 


38.14 


" 3. 


06' 


' 37.57 


^.08 . 




Toleyance ' 


37.*71. 


3. 


15 


36;64\ 


2^21 . ^ 




Social Desirability 


19,64 


'4. 


34 


20.07 


' ' 4.04 





./ Sujfunari^ Scales^ 



Individual Adequacy ' 83.14 
'Interpersonal Cornmunications ' 90.50 
Socicd Adequacy ;: 111.29 



la: 79 

9.5i8 
g.26 



^4.57^ 
95.36^ 
108.07 



^9.15 
7.7± 



u ... 
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Fir^t.-yecir 'students demonstrated^ significant growth on the Openness^ 
' ^ ge (F=ir.67, *df=*l'and 12^ p<.01),and Tolerance (F=5.98, . * 
d^^' and 12^^ p<.04) subscales. Secoj;i^-year studef^ts demonstrated 
egative growth on both of thes^ svibscales- (F's==8/71_ and 9.65, 
respect ivsel^, with*df=l and 9 each/ and p<.02) "as well as on Social 
Commitment. (F=7.13, df=:l and 9, p<.03). , Howeve^, SY stu^n'ts 
exKibited positive growth on Work (F=6.94, df^l and 9, •p<.03) ' and 
Boles (F«8.i7^ ^' p<.02) and approached significance on 

the Trust- and Self Reliance subscales' (F's=4.18 and 4.04v 
respectively, with df=T and 9 each, and p<.98). There were " 
significant dif ference^_ir\, change >eitW^D.-FlLan(i^ SY*^i;ifi(fe^tS.,aa_u. 
the sub^les of Social Commitment (F=8.73,' df=l and 25, p<'.01) ,^ ' 
Opennes^o , Change {F=24.80„\df=l- and it5/p<,001) • and Tolerance 
{F=19.9ff, df=Tl and 25, p<;.Obl) • , . ' • ' 



Th6' Social Desirability scale* is a "lie" scale designed to estimate' the 
"fake ^factor" o'f response Higher scores indicate a tendency to respond 
i*n a 5Qcialiy 'd)bsi*dDle manner, "niere was no significant change on-this. 
sca^e. The* low score indicates generally horiest responses.^ 

aftiese subscal6* scores can' also be combined to form thre^ smranaxy 
scales: ^Iiii^vidlial Adequacy, Interpersonal Conprunications and 

^Social Adejiuacy (OJables an^ .y First-year- students demonstrated 
signific^t positive' growth on the Social 'Adequacy stamnaxy scale 

-(F=12.41^'df=5=l'and 12, p<.01)^, while the SX students showed a • , 

sigiiif leant decline 0F==l7'.2'2,, df=l and 9, p<..O10 . Thi^ difference ' 

-between the two' groups was highly significant (F=5.99, df=l and 25, 
p<.03). -^e SY students also approached significant increajses/on 
the IndiviV^ CF=4.0J., df=l and 9, p<.08)^ and Irrterpersoncil 

<iommianications- (F=4^.69, df=l and 9, p<.06) suRiinary scales. 



Growth in educational aspirations was estimated by asking students 
the highest level' of education to which tlt*ey aspired ^t the . beginning 
and end of the program'-year. : These data were available only for FY 
students.^ The mean increased significantly from 3.35 to 3,71 diiring 
the year (F=11.81, df=l and 14, p<.01) , demonstrating positive 
growth in educaticJhal aspirations. . — . , ' 

Grci«th in^cccupational aspirations was! estimated by asking for the 
two primary occupational goals of each student at the beginning 
and end*' of the program ye*^. These occupatidiial goals were 
converted ^to Hollingshe^ad occcupational codes, which were Jihen 
averaged to get'^cua average spcioecoriomic status level for each - 
time period. These data weye also available orily**SESr FY 'students . 
The" mean decreased from 3.'Zb to 2.97, but this difference was ndt 
significant. Hcwevfer, this reflects a movev.towca:<as occtrpations 
higher on the occupationau sca,le, since the most desirable occupations 
are rated "1" with the leastlsewarding as "7". Thus,i*occupational • 
aspirations in^crdased*for FY students.' ' 



< 



4 



116 

G-13 



4 * 



.Student Eridrof- Year Questionnaire , ' 

• • • • • • . ; ' / ' 

A student questionnaire developed by NWREL was cxDmpleted, by each 
of the students in May. TKe purpose of the instrument was to 
obtain end-of-yeeir data 6n certain- questions asked of the saine 

. students at, the beginning of the--ye'ar^ to assess student kifowledge 
of job trendy jLcid related information and to collect data od| 

' student ref lections. ^Sgut the school/ (CE)^ experiences^? *A • 
tab\ilation of responses to the questionnaire is displayed in 
'-^ Appendix C. ' , 



V ^ f i i 



In response to a questipn on future plcuis, 41 percent of the- FY 
studfents and only 29 percent; of the 'SY^ students reported plans 
to be working full-time one year after ^high school. In comparison 
with the responses to this quesjj^ton for FY students at ttie 
' be.ginning of the schobl yecit, nd stxidents rather than 29 percent 
indicated they had no idea what they would be doing one year after 
high school'. » - r v ^ - ^ ' 

Most of the tTf students (94 percent) and SY students (86 percent)* 
plan to continue their 'fonticil education beyond high school, " Sev^^ 
perdent of the SY ^students but none 'of J±e FY students 'jJl'an to^gqZ.^ 

^to .a grad^fite or pro^essioneil school beyojid <X)lJ.eg^ W^^e anot3i^.| 
24 percent of th^CEY- stu<3ent& and 36 percent pf the SY students 
plan to gr'aduate from ar four-y^ar institution* At. the beginnings 
of the year 18 percent of the FY students plahned to graduate from ^ 
• college and another 6 percent wanted, to retfexVe graduate or 

. professional training.- ^ i 

- ^ ! ' ' ' * 

Fifty-nine percent of the FY student;s, cind 71 percent of the SY . 
-Students reported being interested i]\ professional,- adqainistrdtive 
.or proprietary careers as their first occupationctl choice.-. Thirty- 
six percent of the SY students and only 24 percent of the' FY 
students were interested in skilled jobs,^and sg;ven percent df the 
SY ^students wer^ i^t^^sted in semiskilled jobsv Only six perc?ent 
of \the FY studefcits and seven percent of the SY .students^ were 
' intere'sted irf un^fetlled oc.cupatiyOns . ""^"^^ 



Twenty-nine percent ^||f the FY students and^^lf of .the^SY students 
reported that they- had wo"0ced' and/or observed at both of the jobs 
they listed as career choices. Only five students, all ^*Y' students , 
reported having neither wqrked nor observed at either of the careers 
he/she was interested in. 



, There we're- no students in either group i^porting'^tfta^they did not 

know the ^teps. necessarx^to-prepar^ for $ind enter each 6f the two 
• jobs,^andJ7J'i>eff<SenF'Srth students and 93 percent- of^the SY 
'—J stSdentIs felt they would be able to coit5)lete the necessciry steps 
for p^pciration and entry into at least one of the---job^. 
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>!any of the FY students* (5 3 percent) and most of the SY students 
(93 percent) ihdicated that their (CE) es^rience in observing 
or trying out jobs infli^nced their choice of potential careers. 
Other factors ,tha^ infiuenced career choice were 'talking with 
people-whof-worfc-^t' tiie jobs (71 percent -for -bo^ FY and SY 
students) , reading ibont tjie jobs or^ tiaJJcing with relatives or 
friends about choices (47 perc^t on eadh for FY students. and 
43 percent" for SY students) and talking with teachers or ' • 
coimselors ^^dDout choices 129 percent of the FY students and 50 
percent of tjie SY students) . At least two-thirds of each group 
of students ve re able to identify jobs that seemed interesting ' 
last year' but^ new do not match, their interests or abilities, 
fi^^etri'ence in observing or trying oyt the job(s) was the. most . . > 
frequent reason selected for chpinging careef* plans i35 percent 

-€or J^T^S^^wdents and 79 percent for SY stiidents) ; -other reas^s 
cited in6luded Te^ading about' the job (41 percent FY. students, 43 • 
perc^t SY students), receiving advice* fro© relatives or friehds ' 

. (12 percent FY students/. 21 percent SY students) and receiving^ 
a^vic^ from teachers or a counselor (6' percent FY stuiients ,14 " . 
percent ^ students). - - ^ ' • * . ^ . ^ 

^^yjpE)^.-^tudents ra't&d- the prqgram -Mgh -in^hetping^ them attain 
thCTp>rografli^goals . iThe only goal areas rated negatively (less 
than 3 on a 5-point scale) by more than two students were iit^roving 
reading and math skills. Students rated the program highest in 
helping them le^m t<f understand more about^themselves, -fit their 
interests/ and fiQ>ilities with potential careers and accept adult 
responsibilities.*- -J^irst--yHarr^stiidents 'ar feljb' the program helped 
them becoijie more^qpen to different id^as and valued, while SY" 
students felt the program also helped them la,) become acquaihted 
with a brocid range* of resources, to use in gatherin'g information 
for yfoi^k and* decision-making and (b) know what to look at whe^i 
considering^ job. ^ Only three SY students and one FY student 
were unsure whether*/ if they had^it to do over^^agsiin, they' would 
decide to participate ia EBCE. No students in either igrov^) had' 
decided or were leaning toward not re-enter Jaig . 

The greatest strengths of the^EBCE program in the opinion o-f 1^}SL^ 
stu^nts were overall quality'~"of the prograiirr**DPPort\anity to*^ Xearn 
about occiipations and motivation to learn. First-year students -x 
4lso noted responsibility for their *own leciming^and^.leaming ajjotf^'^'"^ 
adults and the comnunity as -other program strengths , '^itle 
student^, iTteicated their e^erience with adults and tl^ real- world 
ais program strengths. ^About 30 percent/of the students*- said-the re 
were no program weaknesses. Of those FY st;udents escpifessing 
weaknesses, the^ only weakness laentioned by 'more .Idian one student, 
was lack of commuhiQation between $taff and stucients .(24 percent)-!, • 
The weaknesses most often n^tioned by-6Y. ^students wiere lack of 
adequate basic skills- development (21 percent) and nonnegotiable ^ 
iJ.roe periods (14 percent)*. ^ - ^ <^ , 

V - • ■" ■ lis' • - . 
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,/ ' SUMMARY OF findings' \ -^^ ,^ 

The major* findings from the '1975-76. evaluation of tii4 demonstrat?ion • 
'-(CE)^ - Tigard program axe listed below: ^ t 



/ 



StJOdehts completed an average of more than the required 
number o£ car^.er exploration activities during the year 
Wd averaged more thanjtwb^ learning levels. First-year . 
' (FV) students completed fev?er projects and competencies • 
than'required* while,.secona-^ea?_'(sy) students /completed 
more j)rojects than reqiSred. i ^ , 
' ' ^ . ^? -, ^ * ^ • 

. 7^ ' 2. In basic ski3J.s, students showed *an aveji^Sge^of one- month's 

• ^ y growth in reading comprehensiqix for eachlmoniJi of program 
■r ■ ' participation even' thougii their pretesi Scores were-^at: a'_ 

high.. level. Students alao demonstrated m^ginal growth 
arithmetiC'-sidDtests*. \ \ ^ Nf. 

"Both (C^) -student groups demonstrated significant growth 

oa^atti'tuie scales' measuri^^g Openness -to Ch^igg^^d 

J . Tolerance, but the SY\grqwth was^ negative, rete\ilting ,in a 
' ' saignificant difference, between the two gro\:ps. Iix addition. 
^ . ■■ - , gY students exhibited positi\c^ growth on Work\ahd Roles 

* ^ ^ and negative growth on- Social Commitment. \ 

" ' • , ' ^-1 ; ' - ^ > ^ , 

FY Students demonstrated positive significant .growth in 
educational aspirations Jtfith a slight increase in 
occi:5>a!tional aspirations^ ' ^ 

J ' 

By the end of the school. year every, student had some idea . 

of wha€ they would lie* doing one year after high school 

y/hile oveat one-quarter did not,^]^ow at the begiiping oi^ 

j^ie year. Over 90 percent plan to continue their ^ 

Education beyond high school. Less ;thari seven percent ^ 

of the students were interested in' unskilled occv^^ations. ' 

■ * V 



6^- Almost al-l of the students reported working at or pbserving 
one or both ocdupations'of prirttary iaterest. Every 
student reported knowledge of how to enter those' careers, " 

. - 

7. "StCidents fated the. E^irogram Jiighest^n helping .t±iem 

^ und&±stand more about .themsejlvesV ^it their interests - 
and abilities wi th potentialjcareers ^rld accept adult 
responsibilities. 'aIT -studentsT^exqept tl}ree who were 
- . unsure, B%id that, if they hid it -to do over again they^ ^ - 

- WoulS deci<^ to participate in EBCE^ . „ * — 
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' 8. Greatest program strenatihs noted by students were overall 
. ' .quality of the program, opportiunity to leam^^about. / 

occupations and motivatiori to learn.' Although airr\pst * 
- one^third of the students indicated ao prpgram weakneji^es, 
six mentioned a perceived lack of adequate "la^iji Skills • 
^ deveiopmeijit and five menticaied a need fo.r ^better staff 
communication. ' ' . . 

9t Staff members peroeived that greatest 'student growth" 
occurred ia^ the areas o^ self-e^teemr individual 
respionsibility, leaning how to learn ^ ability to 
communicate with adults (including parents), oral and 
" j^/ritten communication, basic skills, willingness to try ^ 

new things 'and coping skills. Moderate growth a5 viewed 
by the staff / occurred iYi awareness of nontraditional 
careers , knpi^!§3ge ^out the job market ^rid career 
, • decision-making skills. " ; ~ • 

10*. In*comparison to the previous year the- staff saw the 

.prograja becoming more stable 7 having .a greater proportion 
, Gf> self-directed- studen$:s, -implementing -the- student - ^ ^ - 

* accountability system, more effectively arjd coordinating 

the student tutoring system better . Problem ar)feas noted 
by the staff included less feeling of a student cOTmjunity 
* and^Iess than desired progress iA integrating basic skills 
• ^ at employer sites.- ' ' - * 

' • . J.1. All staff members indicated a willingness ^to participate 
. , " . in EBCE traiaing and demonstration activities in the 

^ ♦ . coming''year and indicated areas in which they. felt they 

^: ' { could ^elp most effectively. » f 
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INTRODUCTWH 



^Ihis report ^es^nts a s\»tmciry of 'evaluation 'data analyzed by, the - 
Evfiduation Uhit of th^ Career Education Program (C^)" at the 
Northwest Regional Educational Laboratory (NWKSL) for Project * 
TOTAL'. Project TOTAL (Total Opportunities TSifough Action Learning), 
Operating in. the Hillsboro School District in Oregon, -has"* qomple ted 
its second year as a NWREL pilot site of the E35>erience-Based Career 
Education (EBCE) program. !Ihe evaluation of Project TOTAL for th^ 
*1975-76 schooL yeacr has been a ,c;ooperative endeavor by the Project" 
TOTAL staff and the evalua^tion unit of CEP. Ihe NWREL staff :has 
proposed an evaluation' design, developed some evaluation, *. 
-instruments, interviewed §±aff emd a sample of students emd" 
analyzed* the data. Hie Project* TOTAL staff have administered 
or colLebted most of the data, coded them emd provided these • 
data to NWREL for analysis and reporting. Since the 'NWREL*staff 
hcus not conducted syst;ematic: observations of Project TOTAL or 
been on site frequently ^jduring the yeeur, this present repprt 
will summarize the evaluatidn data that ^ave been emalyzed but 
interpretation of thesfe findings and^ recommendations for program 
modifiqation should more appropriately "come from the project 
.staff. " " ' , ^ 

Tlifo sections .comprise *this report, fflie. fiirst section contains a 
description of tHe commianity, the program, staff, /en5)loyer network^ 
costs and l)articipating students. ThI second section contains the 
evaluation findings of prograjn outcome?. A description of ' each of 
thp following instruments euid r;elated .findings is presented: the 
Comprehensive' Test of Ba^ic Sk'ilis / Psydhbsocjal Maturity Scalfe / 
' self -Directed Search , Student Opinion Survey, Student Project - 
EvalviationJFQrm, Student' Erfd-cff -Year Questionnaire/ Sair^le Student 
Intedlitew) s'taff Questionnaire and Interview^ Parent Opinion Survey 
and E^loyer Opinion Sitrvey. - . _ * „ . 

DESCRIPflbN'bfi. PROJECT 

HillsboroV Oregon, located approximately 'SQ miles west- of Portlcti>d,' 
is the county ^seat ^r Washin^on County. Hillsbbro covers 

• approximately ten square miles and had a pqpMation in 19'f5' <5f 
19/160. . Between 1960 an'd* 19 75, Hillsboro"^ has hfeid an annual , growth 
ratie^of Six percent. It functions as a Service center, in an 
agricultural area and has j^ncre^ii;igXy^:^anded as a- ^uburbein 
community to.Portl^d: CoUnty government/ foodr processing and 

"retailing are some of its major ^feurces of revenue., V. ^' • 



Uie :K)TAIi: program is based pri^^^ajrily on the EBCE concept piloted ^ 
bjA four Regional educational research -laboratories under the 
avispices ^nd funding of the National Institute of Education (JjIE) . 
.Most of the irt^terials and strate|i6s employed in the TOTAL program 
vwere adopted or adapted from the/fcomir\unity Escperiences for Career 
. Education , 
NWREL. 



(CE) , as^developed and directed in Tigard, Oj^gon , by 



TOTAL is a pilot altezmative education program whicl^ was developed 
ta-help students 'in grades '% to 12 who have-not sxicceeded and 
pr6g;ressed in the regular school prograitfi, - TOTAL was funded by 
- the Hillsboro Union' High^ School 'District and received supplementary 
^ funding from the state-^ As an. alternative education program; 
TO'Sal focuses on learning through. real, occvqpational experiences in 
the working community. Reading f writing, communicating, confuting, 
coping^f choosing and working skills are acquired tfirou^ 
experiences in a v/ide 'variety of occv^ational situations'. Students^ 
. may utilize these learning opportunities primarily to identify and 
prepare for an occupational area of their choice pr additionally 
to a^uire b^ic learning skills* and the in^'rtarit persgnal and^ , 
social skills needed in today's society. . T * 

The first year (1974-75)' of the TOTAL program w^us spent devel'6piftg 
and testing an individual, learning management systMi with emphasis 
on vocational, and life skills.; A special l^rriihg management team 
consi^ing of a learning meinager, community coordinator, student ^ 
'coordinator and peeV aides 'laeXped each" studlfit. selefct- and complete 
those learning pbjedtives and activities which were best suited 50 
^ the interest and ability of each student in the program. During 
the first year the primary 'goal was to develop the learning* 
jnanageroent system and, therefore, the enrollment was' limited to a 
maximum of 3Q students. r • ' ' ^ , " 

During the second year of Qperation Project' TOTAL, refined many of-^ 
its instructional* strategies,- added some new con^etiencies and ^ 
expanded' enrollment to rifetweep 50 5ind 60 students while adding 
only .an educational assistant to the staff. By Decexrtoer, 1975, 
TCJTAL^ad 54 active employer. ^ites participating in the^.program^ 
wi'^Pan average of two einplbyer instructors per site. 

* Project TOTAL dgerates out "of two former classrooms in one Ving of 
Hillsboro Union High School* Ihese two i;o6ms provide offices for 
f the staff , student woxkfing space ,^ and storage for project r^ource 

\ inaiterials. 'Oii^ project operated at a cost of.$64;000 which * , . ♦ 
included stuj3^nt transportation but exclude4 overhead such ^s^ ^ 
facilities costs and the salary of the part-time director. Of *the 

^ $64,000 budget, $17,000 »cai^ thro)igh special* state fun^s ^^d,.the * ^ 
remainder out of the regular school district fmids. ♦ "-/"^ 
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EVALUATION FINDINGS ■ ^ ' " 

Program Fidelity " ^ ' , / -< 

OVo checklists were used by NWREL*at the beginning and end oi the 
1975->76 school year to determine the exteht to vrtiich each of , the 
pilot sites was operating in a mcinner'"4;onsis4:ent with the/tWHEL , 
Brtodel of EBCE;-''*One cheqS:lisl:f rhe EBCJE- Esseirtial ,(3iaradreristics 
Checklist, covers five coir{XDnent areas of the program; ^ese ■ 
con^oijents* are that E^BCE: r^. is an Individualized' programr 2) is 
a comffiunity.-based program, 3)., is* an* e35>friishce-based program and 
is built 'from th6 -career activities, of ''adults, 4)' must have its 
oyri identity and be conqpreh'ensiye and integrated, arid 5) places a 
jSi^^oi eteph^is •tm'^th^ **career; developljient of students. Each 
c6t4>onent area is. rated' sep^ately onJfroiiL fpur to six essential 
' characteristics dji , a sc^le, ,ef one ^o five with the anchor points 
'prespebified^ , * . ' * ^ — 

" / . ' ' ' 

A* second checklist, the EBCE Process .Checklist, is intended to 
complement the- EBCE .fcSsentiel Q^aracberistics Checklist and was ^ 
also used at tiae beginivLng arid end of *the 1975-76 school^ye^ir. 
While the Essential Characteristics phqcklist' identifies basic . 
policy and philosophical characteristics of an EBC6 site, the 
process checklist is designed to identify deviations in procedures - 
Osed -in. operating an BBCE prc^gram. ^is process .and <iiecTclist 
consists b5 four sections: « 1) EBCB dbjeptives^ 2) managemen-b and 
•/:>rganization p^rocesses, 3X curriculxim em^ instruction processes, 
^) Student service processes. Each section in turn contains 
separate itefiasr ^ - » \ 

For example, on the item dea^ling with stusient projects, •the project^ 
director and the evalu^tgr are asked to check those .Lifia SkilL 

^project areas th.ai: are,,a.'p^t.of the program,"' to identify whether 

. each project area is required or optional for students ^d t^o- 
determine whether ;the particular project is designed lijce thati^-in 

•the.EB(iaE handbook or operates iiifferently.- In cases where a . 
process operates 'diffe:^eritly from, the NWREL jaodel, a description \ 
of the differences and a^ rationale for these differences is 

-^c^btained. ^ ^: \ - ^ 

^ Each of these two checklists was completed by ^ the project director 
and* separately by the NWI^L eyaluator.' IJip results of the two 
diecklists together provide an exfcellent ^profile description of ^ 
the programt/^ Hi^ ratings given by .the ^ project (|irector arid -by the 
evaiuator were highly consistent. ,0n We diecklist ratings made, 
during th^- first semester, a high; rating (4' or 5 on^a" 5-p^int sCale) 

-'Was gfven.to*2l of the 24 essential characteristics rating scales. . 
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Uie on^. Scales receiving low or mid^e ratings^ (2 or 3) werfe • 
related to the \2se of cpmmunity iriput into program planning"'and 
"operation, the role of the ptogram advisory board and provision 
for employer instructor training activities • Ttjese ratings were ^ , 
somewhat lower than the .rest, because the project does;^ot have a 
separate program advisory board but instead uses tiie district's 
"career education central advisory committee and. because ho group . 
employer training sessions ha'^been planned. At the end of the 
'year, the ratings regarding 'community input into jprogram. planning 
and ogreration had imprdved because .community menbeyrs \^e re .involved 
more intensively with the program dxiring the- year and had- input ^ 
into a- related career education Part D propbs'al. An employer 
training seminar was ^so held d\Hring> the^ySar^ In summary, the 
twb program checklists indicate tiiat Project' TOTAL is operating ^-as 
.a high fidelity EBCE pilot site--^ A copy of the two checklists 
from June,. 1976, is located in Appendices A and B to thia report.*^ 

Staff TJuestionnair'e and Interview ' - ' ' ' 

The tho:^ operations staff rated each of the EBCE learning 
strategies ^on a 5-poin1: scale as to their importance and 
effectiveness. All 'of these strategies Were rated high as a "4" 
o/"5" on importance for each scale^^y all four -staff menbers 
except for the predesigned ptojecti which were rated- as "3". ^ • 
The meaft level of perceived ef fectfLveneSs" for each of these 
strategies was highest for cQiigfJafencies and for learning level 

activities. The lowest ratings ii^ perceiveql ^effectiveness were 

for predesigne'd projects and. for student negotiation. ^ 

In response to a series of questions ponceming the. extent to which 
^ BfieE experiences help stiidents in 23 areas, oAiy one mean 
response was below 3.0 on a 5-point *scal6. This area was in 
helping students -xindfeirstand-the role of _science^ in-society ^ 
today. Higgles t ratings were in helping styUdents understand 
^mo;re about themsel^^es,.,: learn how their inte-2r§sls '^nd .abilities 
fit i/ito potential careerfe^ learn' how -^t?© find and keep a job, 
learn basic skills necessary for careers that interest t^em^^ . 
improve oral communications, take responsibility for their^^^,^- . 
^,^ct ions and communicate comfortably -with adults. - ^ " 

(greatest student^ growth was perceived by the staff in the area of 
personal/social development, sel^-awareness and ^relationships with 
adtilts. .Least growth, acdordirig to staff responses, was made in 
basic*s)ciils^-and in student accoiintability . 



FaK:t9rs seen by the staff as contributing to the success of the 
EBCE program incliide clinical staff sv^jport, a "strong project' 
dijrecto^, a yeaif's experience, more structure for the learning 
center activities, \th^ cpc^e^ation of the emplbYejrs and the»_ ^ 
.packaging of compet^^es materials. Obstacles se^n dS; limiting 
'the program's success incli;ded 'teacher mistrust of EBC&, student 
,transportat jx>n , -students, with behavior and remedial problems not 
receiving adequate .help and too many student? P^r staff tnember. 

For- next year, staff recommended admitMn^^'^fewer'rstudents^ with 
emotional problems ^ more structure, *'a^n ixaprov^ basic skills 
program, less .paperwork and be^tt:ef use of 'tutors, aftdcddes. For, 
* a^con^lete listing of respor^es to .all questioiuiaird items ,. see 
Appendix C. ^ S ' , 

12-'question individual staff interview was' conduc^ted by the 
evaluator in April, 1^76, to determine, in more '^tail the staff's 
^perceptions^' of .the^proiect's second-year operations. ' A tabulation 
of responses* to this interview is located in AppfenSix *D.^ Of 
special interest to ^readers may be the question asking the staff, 
what changes th^ey ma^e in EBCE. New activities described weijp in 
theiuse of-^ volunteer- high school students as tutors in basic 
skills, daily 'group feedback. sessions to enable students to share . 
their job site experiences with staff and fellow stirferits, , . 
developmejpt of ' a more stftiotured time- schedule for s,tud§nts,. use 
of a jLeaming assistant and the starting of a part-time EBC& 
program for nine "students in seventh and eighth "grades. 

Student Description , . , ' . ' < 

Ohrou^qut the year, approximately 60 students pa^tic^ipated in. 
Project TOTAL. * IVenty-four percent of tl^e students wer^ girls. . 
tn terms #f grade level, fipprqximately 20 percent were in - 
grade, 9, 41 percent in gr^de lO, 29 p^cent 'in grade 11 an<i 
10 percent in grade 12, , At 'least--teni,atudente were terminated 
from *the, program over the ^course .of .the year. .'Of' "the remaining 
students, .26^had. complete.pre and po^€test data^cuid^er^ used 
for statistical analysis. Of tllis nuntoe^ 92^pef:cent indicated 
on an end-of-yeeur questionnaire that they planned to "graduate 
^from high achpol aiid 44 percjent indiccited intentions to pursue 
^ posts ecbndary education. Eight percent** plapiied to complete a 
four-yecor college program. Forty-four petc^it of the students , 
e3(pected *to "be Voncing full, time one y^ar after completing high 
♦school*. • , 7 . 
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The average number oj^^student process outcomes, compl'eted by these 
students^ and average number of days absent ' a^re displayed in Table 
1 "below where tl^^ me§ii^and standard deviation CS»D.) are shown* 



^TABLE 1 



Average Number of Student Process 'Outcomes Completed 
* and Days Abselit 'Per StudeAtlLn'*'"'^^ 

' ' PROJECT l^hL/, • ^ 

\ • . ' (N=26) • . / 

^ * • . - » Mean ' • ^ S.D. 

Career E:Q>lorations ^ ^ 10.08 * 3.10 

Learning Levels 2.50 , ' .99 

Skill Building Levels. ' ^* .54 . /e » 

' Projects Y • 2.11 y63 

Con^etencieg / 2.35 • . " ji.52- 

, Days Absent ' * ^ 18.27 " ' yi2.23 

^ Students in PrcJ^fect^ TOJAL cpn^leted more than twic» the number of , 
capeer explorations ifequired by- the program -design but fewer. 

- student projects, cuid competencies than were e^qpected. In terms of 
attendance, they averaged toore days gbsen-br than any^othef' s^tes,. 
which would be e^^cted considemng the ?f act that ;^many ^^of^.'^e 
students wer^ recommended for the parogram based oiv-^ast faiULuSre ^ 

, in the* regular school program. Data collected in £97'4-75 ' 
indicated that the average percent of time in attendai^ce at 
school prior to entering TOTAL, wa^ 35.7 percent &3?- last ye'ar'^s ^ 
TOTAL students. While in TOTAL, stuxients* average attendahce • 
rate last year was 87 percent and tSiis year wcis 90 percent.- 
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Growth. Data \. ' ^ 

' 1 • • . \ ' ' ' ' - 

The MOBTfVAI^ANCE program was used to analyze growth d^t^.,; 

Growth data collected at Hi^llsboro consisted of^scor^s for the 
x«^ding coii)p|3eihfin§.i9n/.X^itto concepts, and ctrithmeMc^ 
applications -subtests of the Ctomprehensiv^ Test of Basic Skills ^- 
(CTBS); the Self- Directed Search ; the Student Opinion Survey ; 
and changes in occ\:5)ationai and educational aspirations, Pretest 
artd pos^test means and.^standord deviations (S.DjJfor the CTBS . 
are^given below in Table 2. Data are reported as e3q>anded ' 

jBtandard scores and as gxa:de equLvalents (G.E./, . Changes i^i^the ' 
CTBS scores were statistically 4signif j.cant for reading * 

* cca^r^ensi-on (F=:5.62, df^l, 22, ^p<;03) and^approach^d^ significance 
fqr arithmetic Applications (F=3,54) d£=l, 22 p<,08>i 

-~ ^ ^, - TABLE 2 . * * , 

^ Pretest and Posttest Scores on the CTBS for 

Project TOTAL Students - * , 

/ . \- {N=26) J \ 

. Pretest ^ , Posttest 

Mean S^D. ^ G,E. Mean S.D. G.E/ 

513.42 103,44 7,Q' 537.15 82.15 7.8 
508^35. 71.89 7.6^ 534.88 75.25 8.1 
516.58 104.77 .r.V 539.08 78. 8.2^ 



CTBS SubteM^ 

Reading Comprehension 
Arithmetic Concepts ^ 
Arithmetic Applications 



Pretest scores were used^as independent variables in a one-factor 
analysis ot covariance of the. posttat^^t scores for each instrument. 
Univariate F tests of .the' growth effects on each variable were 
'used since the smcill number of siabjects limited the* rdultivaria^te^ 
analV%is. F^nn, iT. " MULTJVARIANCE : A generalized 'univariate ' and 
multivariate anstlysis of Variance/ covag^ance-^d regression . ^ ^ 
Version V. Chicago: National Educational Resources, Inc., 
March>.1972. 



Ihe Self-Pxrected Search , developed by John Hcrlland, was used to 
identify "occupational personality "^^haracteris^tics of each 
studeift'. These six coreas are: realistic (e.g. , skgLlled trades, . - 
technical and some servi'ce occupations); investigative (e^g^,,^ I 
scientific 'and come technical occupations); artistic; social 
(e.g.'f educational and s6cial welfare occupations^ ; enterprising 
Ce;g., managerial cind sales occupations); cind conventicfnal (e.g., 
office cind clerical occupations) . - , - , ^ 

^t..is-also possible to ccJLc\ila,te sij^ other scores from this 
instrument:^ s'elf estimates , activities^ competencies ] occi^ations t 
differentiation and consistency. The self-estimates score ' 
represents the student's total self rating (on a seven-point scale) 
score across 12 traits such as mechanical ability, 'artistic ability 
and office skills. av&-^c^ tl^ese traits reflect each ojf the six 
occupational categories. ^Students rate themselves in comparison 
with other persons of ^the same age. TJie' activities score 
represents the*-student's total number of* jactivities across the six 
occupational categories that the student says he or she likes to 
do» Hhe competencies' score represents the total nunber of 
activities apross the six occi:5>ational categories that the stud^t 
feels he or--she'can do well or con^etently. Ihe bccv5)ation£ 
score^represents the total niomber of occupations that are of 
interest or. appeal to the student.' Ihe differentiation score 
describes the degree to which a person, represents a "'pure"^ ■ 
personality type. A p^rsen with very Strong "Social" interests 
smd coittpeti^cies , for exan^le , is more of a "pure" type than a 
person with modera^te "Social," "Enterprising" and "Conventional" ^ 
interests and competencies. The differentiation code is computed 
by subtracting the numerical weight of the tertiaiy score from 
the'weight of the primary c^e. Ihe consistency score is an index 
of the internal consistency of- the personality. -Operationally, 
it describes 'the degree of compatability between the primary and 
secondary code. For example, a person with an "Artistic" pj^imary 
code -and a "Cpftventional" secondary^ode will probably e^diibit 
contradic1:ory brehavi^r patterns and interests and receive a low 
consistency cci^e. 



Pretesfand posttest means and standard deviations (S.b.) for 
subscores on th^ Self-Piredtdd Search kr^^^s\own 6n the' follo^ihg^*-*^ 
page in Table 3. 



TABLE 3 

Pretest and Posttest Scx^res on the Self-^Directed Sear'ch 
. for Project TOTAL Students ^ 
(N=26) 



Pretest 



Posttest 





Mean 


s .p. 


Mecin ' 


S .O. 


KectxXSuXiZ- 


^ 10 


,75' 




10. 


50 


4 29 


Investigative % 


6 


,65^ 


2.81 . 




3.07 


Artistic 


6. 


,50 


2.97 


6. 


58 


2.98 


Social 


8- 


^4? 


3.62 


8. 


00' 


3,68 


'Enterprising ' 


— " 5 


.77 


2.52 > 


5. 


19 


2.91* ^ 


Conventional. - ' 


" A 


.00 


2.84 


3. 


50 


* 2.60^ 


SDS Summary Scores , 


\ 












Self-Estimates 


.22 


• 31 


7.70 


24. 


^23 


M.40 . 


Activities 


'25 


.23 


12.70 ^ 


25r. 


77 ^ 


12.97 ' 


Cbmgpetencies 


23 


.46 


12.18 


- 24, 


27 


13.52 


Occupations 


15 


.85 


12.85 


11, 


46 


10.11 


Differentiation Score 


6 


.27 


2.60 


6- 


19 


"2.56 


Consistency S^re' 


2 


.31 




2. 


46 


.81 * 



Si^ificant. differences in pre and posttest scores were' not 
e:q>ected for.th^ six occ\:5>ational areas sii>ce these factors 
usxaally remain stable and an increase-^-in interest in one 
occi5>ational /area often leads to a decrease in another. 
However^ there weis a near significant increase in^invesiJ.gative 
occ\?>ations (F=3.1l/dfel,^ 22, p<^05). 

Ih/fe total self-eptimates f activities ', competencies arid occupations 
/I ^afbores were anticipcited to increase over the year as students 
gained a varielr/ of work experiences cind perhaps earner to view 
themselves"* in a' more positive li^t. However, althou^ , there were 
'increfases on roosi: -of -these scores ^ 



changes . 



they were nonsignificant 



Increases in differentiation* an'd consistency were!) hypothesized as 
a result of students-* observihg and 'trying-out a variety of jobs 
and-- learning, to discriminate more in what activities they like ; 
and dislike. The differentiation scote shov^ed litMe change but 
TOTAL students^ did demonstrate significant growth in thfe 
consistency of their occ\4)ational selections* (F=5.33, df=l, 23, 
'P<.04r.. . ' ' * ^ . 
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[Ihe Student Opinion Scale is a local name applied- to the 
1 Psycixosocial Maturity Scale developed by Ellen Greenberger/ The 
instrument is used tQ assess growth in nine different areas, many 
of which are related to ^the EBCE. Lif e Skills goals, Ihe, results 
from this instrument are presen€ed in Table ' 



TlVBLE 4 



Pretest and Posttest Scores on the Student Opinion Scale 
for Project TOTAL Students 
(N=26) 



Pretest 



Posttest 



Individual Subscales 


Me^ 


S. 


D. 


Mean 


S. 


d; 


« 




<^ 


0 










Self Reliance 


26. 


81 


4. 


42 


?8 


,-31 


3. 


40 


Work 


25. 


73 


5. 


59 


24 






Identity 


24. 


35 


6. 


20 


25 


.54 


5. 


00 


.Communications 


. 21. 


08 


5. 


10 


' 22 


,27 


4. 


90' 


Roles 


' 31. 


46 


5.^ 


54 


^ 31 


.50 


5. 


59 


Trust* 


27. 


04 


4. 


10 ' 


27 


,46 


3. 


87 


Social ComidLj^nent 
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-•flie Social D^xrability ^cale is a "lie 
estimate theMfake factor" of response. 



scale designed to 
Higher^ scores indicate 
a tendency to^ respond in a- socially desirable manner. The TOTAL 
scores on this scale indicate that students w^re "responding in 
honest manner but tended toward the more soeially desired ^ 
responses at the ^nd of the year. \ . 

*Th^se* subscale scores can also be conbined to form three summary 
scales: Individual Adequacy , Int^ifpersonal Communications and 
Social Adequacy^(Table'4) . - ^ . 
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ults of the multivar£a\ze analysis of change sc»3:^s .indicate 
, at Projects TOJTAL students demonstrated statistically significant 
growth in selfc'relicince (f!r22.44, df=l, 21, p<.001) , trus^t (F=10.97 
'df«l, 2Xf'p<.pl)r change (F=6. 16, df^l, 21, p<.03) and tolerance 
(F=^4'.82, df=l, 21, p<.04) scales %nd approached significance on 
the work scale "^rP=4. 13, df=l, 21, p<.06). TOTAL students also \^ 
demonstrated significant growth on the summaxy scales of 
individual adequacy (F=5.66^ df=l, 21, "p<.a3^ ,_4j:^terpersoncJ.^ * 
commtmications (F=14.27,^ df=l, 2i, p<.01) and social adequacy 
(F=5,53, •df=l, 21, p<.03).- Ihese results are particulai^y 
iit5>ressive since little significant growth on this instrument 
was detected |Lt the other two NWEEL EBCE pilot sites using this 
ihstr\ament on a pre and posttestT basis* - _ ^ 

Student End-of-Y^ar Questionnaire"' • - 

^ JlwS^den t^xg^uegiuxannait ga^^veJLo d by NfWRBL was cpmpleted by TOTAL 
students in May. The purpose\of the instrument was to obtain 
end-of-year data on certain questions asked of the same students 
at the beginning of the year, assess student knowledge of job ^ 
trends and related information ^d to cpllecft data on student' 
reflections about their scK6oL.EpCE experiencesy^ A tabulation 
of responses to the questionhaird^is displ^aye'd in Appendix B and 

^s based on the 25 students who Were in TOTAL for the entire yectr 
and who con^leted the, pre and posttest. * 

Over half df the ioiAL stud'en^^ they had worked 

and^r observed at both jobs they li'sted as' csare'e'r choices on 
the questionnaire. Only tWo- students regtor^ed having neithfer 
worked nor observed at careers they were interested in. 

pnly one .of the TOTAL students "reported .that Tie 'pr she did not 
know the steps necessary to' prepare for .and enter- each of the. 
two j^s , and two-thirds felt they wotild be able to -coinplete the* 
. necessary steps for preparation and entry into at least ope of the 
jobs. * The remaining one-third indicated they, were unsure. 

Ffost of the students (72"percent) .indicated that tfieir EBCE 
experience^n observing or. tJying out ^e jobs influenced ^theif 
choice of_potential careers. Other factors that influenced 2 
career choice were 'Stalking with people-, who work^t the. joBs (48 

percent J , j:eadin<g' about the^joSs (20 per cent) , t^lkihg with 

relatives or friends about one* s •choices '{.28, percent) "arid talkihg 
-with teachers or counselors about choices {2 i>erceht) . Eighty 
percent jof the students- were able to identify jobs that seemed ^ 
interesting last yecir but no longer match tiieir interests^ or ^ 
abilities. Experience in observing or trying out the f6b{s) was 
the most frequen^ reason selected for changing career plans > 
(16 percent) . , ' * ^ ♦ . - 



OSie TOTAL students rated the program high in helping them attain 
the program goals- The- goal areasf in whiqh i±ey reported^the ^ 
program ^least effefctive w^re in oinderstanding the role .o^ science . 
in oiir society, underp;tanding the -democratic process and improving 
writing skills Students rated the program highest in helping' 
them leaxn to get along with others. " . ^ 

In comparison, with the. regular high school program, w80 percent of 
the TOTliL students ,feli: EBCE provided them with more opportunity 
for learning about occupations, 88 percent felt it provided them 
with more opportunity^ for general learning and==-76 percent felt 
it motivated '^them to learn more- than did their past e^eriences 
in the 'regular high school. ^ . . 

On an open-ended question, students were asXed to identify^ the ^ 
.perceived str||gths*ana we^ness^s* of Project TOTAL:""" S€rengBis'^^ '' • 
most frequ§ntf|^ listed were job site training and opportunities . 
"(45- percent) , ability to choose^ what to learn (17 percent) , 
ability to work at yo\ir own rate (IS percent), leatning what is , 
important in the outside world (12 percent) , job site-eQ<J>lorations 
(10 '^percent) and a helpful.and trusting staff (10 percent). ^ ^ 

Twenty percent of the students indicated they saw no weaknesses. 
Of the weaknesses listed, the .most conanon were ^students misbehaving 
•or actipg silly (8 Ifcrcent) , not being able to get preferred job 
site (5 percent), not , enough staff ^help (5 percent), projects (5 ^ • 
percent) and oompletiEfg daily plans (5 'percent) . 




In addition to .the evaluation d^taTc^Jiieeted^snd^^eported for all. 
i)roject sites, the .NWREL *EBCE evaluation unit alsg^requesteijttiat' 
EBCT sites send' copies of all student written Life ^ills^proj€ 
aitd resulting pr^iiftets (reports) for*a random sample of five 
studertts^ The ^selection of the'se five studei^ts was done at IWREL 
t^sing the TOTPJj program roster and 
Student ^ejects "and written products 
because these projects aire oneiipf *the 
u5ed \n EBCE' to help integrate ^tuc 

center with those at employer aijjd commvinity sites. The evaluators 
' feel that a close evaluation of %iese student projects and 
^pro3!ucEs7--whil§^ti con^j^Qiftg^^-ean-'^^e^.one of the best ways to 

assess the pxirriculum asj^dcts' o5^ EBCE. 



)le of random n'lroibers. 
^ere collected and analyzed' 
jor leatning strategies 
btivities at the learning 



^11 stiiaent Life dkills_projects and proc^ucts prodiiced by fotir, of 
the fiv# sampled sV^^ents were r^eived, "read aijd irated by^a NWREL 
Mtaf f jmeitber- using ^ Student Pro/eats Evaluation Form, Ohe form 
contained twelve categories formating the^-proje^sts^tunS ^£ive categories 

• for ratir^r the written products . Each rating category contained 
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-'^^a nine-point scale and^a place for written ev^uator comments. . A 
. I^abulated copy^pf the Individual and CJombjned Project Evaluation 
forms is located in T^jpendix G. , * • 

Of tiie four, students whose pjrojects and products were reviewed, 
.two had^GOBppleted two ^individually negotiated projects and 'one 
. pjredesigned project and the other two Students had each conpleted 
*6nly an in.dividualized critic'al thinJdLng project. Prior to 
/rating each'of "these eight projects arid p^roducts , the *re^>iewer ' 
. 'vTeviewed the test scores of these students to get a^°feeling for 
the. ability le^l of eadfl student./ » ' / ' ^ 

s'. ^ - - ' , ' .t 

• Prior to rating these projects, the NWREL staff member, an \ 
eyaluator and a recent Tigard (CE) learning manager independently ' 
reviewed and ifated^oui: student projects from another EBCE pilot 
site and then discussed their findings* In cases where a 

. discrepancy of more tban two pdints on an item occurred, the 
raters "described the rationale for their choices and their 
interpretation of what was meant by each^jffcale; The discussion.;' 
helped to clarify the meaning of each stsale; . Reliability leVels 
among the -raters will be caicula^ted and reported to NWREL in 
iSept'wbef, >JL976^' . ' c 

. Student- praiects 'were rated highest .i]j , regard? to incorporating < , 
basic skills, capitali^ng- JDn student-^^terests , coptedning , 'y.- 
adequate performance criteria,' appropriateness of project 
activities for the student's abilities and I2ie logic^ 
relationship of activities. Student projects w^re rated lowest 
;,in^meeting the .specificfobjectives.of the Life Skills area .and 
in jusing a variety of resources*. In evaluating the students* 
p'roducts, (generally/ written reports resulting from- the projects), 
it was judged that most products dbmmunicstted welL an*d hacj^at 
least adequate technical^ quatlit/ (e.g., legibility arid grammar) 
relative to the student^ k ability. • ' 



Employer Opinion Sufv|^ 

In May, a NWEEL .developed opinion survey yasv^msdled by th^ TOTAL 
^^L^^ — ^1 — ^^^J eiiqg>loyers . TKirl^^^ight ljuestibnnaires. 



-^H:M-fHfd^-75-|>a2rt±cipaj^ 

were- tetumed for a respc&tse rate of^5t:pie?rceni:.; Timing at the . 
end of the schoof^year did not allowljjfory^^ folicwtp mailing, to,^^ 
riof^respondents. ' -A tabulalied copyv,of Ox^^^^^^jfcer s\ic^ ' '^.r. 



-located. in Appendix H; 



En^lpyers reported a medic n jof 5.,4 hbura^^pe^^r^eek th^trithey, spent 
_ V(orkin^,with^^SjtjLr9ents on e^pLoration-^Le''$r^ls'.aftd -8.5 hours per -* 
, week on. learning leWi^/^ Ictiririg 'e:a>lor^t£ca .levels , the mostr' 
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frequent employer activities Vere^ talking ^oiat site activities 

percept), supervising students in performing, specific job 
related tasks^,(63 percent), talking ^afoout job opportunities (55 
.percent) aifd evaluating individual students' >assigpmerftS; (5.0 
percent). These same activities occurred at learning levels^ . 
usij^ally^witht-a greater frequency. Probably the single b^st 
't;eviden6e^of strong eitployer siropoirt ""for TOTAL is that" 100' percent 
♦of ,the employers txDmpleting the svyrveV indicated that ±h€iy would: 
'^r^coiranend* to^ a ^tential^ eflpioyer or ^resciyrce person Miat he or ; 
• >he also become ^nvolved^ith the "prpgram. Eighty-four percent' 
of ^the enqployers stated they plan to contd^nue participating with 
the' program next yealT. df thos^e who do not plan to continue , the, 
reason stated was lack^^^time . None of them indicated that they/^ 
. felt the program wcis ineffective or. that they were not? cpntinu^g 
beca\ase of problejns with the students,. or staff.' .* - « I 

"The four^ str^gths of TOTAL checked most frequently by en^Ioyers 
^ are that stiidejits leam^about real life si'€iiations (87 i>^tQBnt) , 
learn cdDout a variety, of careSrs 09 percentf.and gain *^ ^ 
<e!3qDeriehce in working with adiilts^61 percent), and 1:^ program 
"is .a. good' alternative to a regiilap: hic^ school program (53 percent) 
The only wetness of thfe program sej^cted )?y ^re -than three ^ 
-employers was tjiat some students cannbt handle- the "freedom (32 
percent) . ' 



Parent Opinion Sum^' ' ^ / ' 

'In May, a NWREL developed* opinion .svirvey Was mailed -by the TOTAL. 
s^ff to parents of 50 TOTAL studerits. r Twenty ques'tionnaires 
were ret\irned 'for a response rate of 40 petjcent.^ A tabulated , 
copy" of the parent survey is located in Appendix I. Qne of the J 
irtost dramatic results, from the questionnaire is 'the effect ^the 
^rograiji^^p^ars to have on increalsing thp communication between ^ 
ycruhg people andtheir parent^\ Before, entering the TOTAL prilgram, 
only" 15 * percent^ ^the parents reportecT.that their son or daughter 
talked with them frequently or almost daily^ about what was, going 
on^ih the jfegular*fe^ool. kfter t^^ing in TOTAL ^ one or-^more"^^- 
years , 60 percent of. the parent^reported that thAr son or 
daughter talked to them, f requentlj^ or almost ' daily dDout what ♦was 
gaing* on'^in- the TQTAL program: • ' . ^, / " > 

> < ' ' - — - / ^ ' A 

Several questions on^^tKe p^ir^nt' survey help to reveal, tlie parents' 

oyeralj^itr^ression of. TOTAL. Eighty- ^ive percent of the parents 

felt that the TOTAL program' experiences for their son or daughter 

were better ^an pastr-iSchpol .experiences and ten. percent felt the 

experiences were ab.out the' s^me-. V ' ^ - . . ' 



' . : - - 

Many parents saw positive changes ^in th^ir son or daughter that 
they felt mighit be a resxilt at participating ir^ the TOTAL program^- 
OiangesUdenti^fied by at leas*t half the parents were greater 
self-confidence (75 percent of .the parehts checked this), better 
understanding of 'jobs (70 percent)-, ^greater maturity or, 
self-direction (66 ptercent) and improvement in basic, skills / 
(55 percent). Verx few negative effects of participating in TOTAL 
were, notirced. Fifteen percent of j^ie^parents felt their son or ♦ 
aughter had become less intereste'd in e^ucata^on and~seveny^perTCi>t 
elt their son or daughter had 'become more critical of otiiers. 



SUMMARY OF FINDINGS • 

* 

^e major findings from the NWREfi evaluation of TOTAL are. listed 
.below: 

TO 



The TOTAL program, is operating as a, high 
^ fidelity NWREL EBCE jpilot sit^. 



.2. ^Students selected for Prpject TOTAL were 9ften those 
- who* had not succeeded' in" the regular hi^ school 
program. . They complete^^ntOre than twice the number' 
of career explorations ' requiifed by 'the progran^ . ' 
design, but fewer student projects and coniE^tencies,^ 
were ^expected. - \ . . 

,3. In terms of schopl^ attendance, students Enrolled 
in TOTAL in 1974-75 av)eraged 36- percent school \ 
attendance the year prior tp ente?*ing this \ ^ ' * 
. , program* Last year students in TOTAL averaged , 
• 87 percent attendance - for that year and this 
^ year student attendance' a^raged 90 percent.- 

4. Students in TOTAL showed .a significant increase 

in reading con^rehension , ap^oached significance^ 
in growth in arithmetic applications and demonstrated 
nonsignificant growth in arithmetic concepts. 



On the Self-Directed Seardl\ # students demonstrated 
' a^signifibant increase-in consistency of occiJ^ational 
selection. xoaaKt that' their c^Str^r preferences 

became more fociised. • \ * . ' 



Frojectr TOTAL students made statistically 
•significant growth^on foeaisures of ^elf-reliance/ ^, 
change/ tolerance and tru^t scales plus all three 
summary scales.^ , Ihese results are particuXa,rly 
impressive since signific^t- growth on these , 
measures was not detected in the other two NWR?L ♦ 
EBCg. pilot sites. 

. ^ ' ^ . • ' • \ 

Only one of "the TOTAL students reported that he 
or, she did not know the^teps -necessary to prepare 
for arid enter 'each of .two careers of interest. 
Two-thirds of the students felt, they would be 
ableVto complete the necessary ^.steps for preparation 
and 'entry into at least one of their two top careers 
o£ interest, ^e xemaining third indicated that 
they were xansure. 

* In comparison with the regular hi^ s'chool program/^ 
^0 pelrcent of the TOTAL students felt EBCE provided 
them with nvore opport.unity for learning about' ' _ 
acci:^)at£pns / 88 pe-rcent felt TOTAL provided them 
with more opportunity * for general learning and • 
76 percent felt it motivated, them to ledTrn more 
than did their past experiences in the regular 
hdgfi school* ^ ' N 

Probably ihe single best . evidence of strong 
enployer support fo^ TOTAL is that' 100 percent 
[ thfe employers completing an employer opinion 
survey in Way"/ 1976 |u indicated that they would ' 
r«ommend to ^ potential enployer or respurce 
^)^son that she oi^ he also become involved with 
TOTAL. '-V" ^ • 

One' of the most interesting results from the 
parent survey iS-thfe effect the program appears, 
to have on increasing the communicatiorte between 
^ young people and their parents/ Before entering • 
the TOTAL prpgram; only l^ercent of the parents 
reported thab-their -son or^ daughter talked with 
them' ^equently 6r almost daily about what was 
going on in J±e regular school. After being' in ^ * 
TOTAL forgone or more years, Qp' percent of the 
parents -reported*, that: their son or daughter talked 
to them frequently or almost Saily about what was - 
going oii in. tiie TOTAIj program. 
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Several' questaons on the parent- ^lorvey help to 
-reveal the- parents ' o^verall inpression of 
TOTAL* Eighty- five percent of the parents 
felt that' the* TOTAL prc^ram escperience for their 
son or i^^hVftV was better th^^ past school 
experiencef .arta ten percent felt the e^jiefiences 
Were^ about the* sanve, * ' ' ^ * 

Many parents saw poiitive^ changes* in their. son 
or daughter that the]( felt might be ,a result of 
participating in the T0T;\L program. Changes 
identified by at leas t-'half the. parents yere 
greater seXf^confidence' (75i)ercent of *the* _ 
parents checked this) ,\^better iinderstanding. of 
jobs (70 percent), greater maturity or 
seslf-diTection* {65 percent) and' improvement in ' 
basic skills <55 pe'rceot) Very few jiegative 
effects of participating'^ in TOTAL were* noticed. 
Fifteen percent olf .i^e pa^tents lelt their son^ 
or daughter hadT become less interested ih^ ' • 
^(iucation and. seven percent felj: their sgp or 
daughter had' bepome. more'' critical of others. 
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